Nov 19 14:43:44 user nova-compute[74934]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74934) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74934) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74934) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 19 14:43:44 user nova-compute[74934]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:43:44 user nova-compute[74934]: INFO nova.virt.driver [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 19 14:43:44 user nova-compute[74934]: INFO nova.compute.provider_config [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Acquiring lock "singleton_lock" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Acquired lock "singleton_lock" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Releasing lock "singleton_lock" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Full set of CONF: {{(pid=74934) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ******************************************************************************** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Configuration options gathered from: {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ================================================================================ {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] allow_resize_to_same_host      = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] arq_binding_timeout            = 300 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] backdoor_port                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] backdoor_socket                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] block_device_allocate_retries  = 300 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] block_device_allocate_retries_interval = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cert                           = self.pem {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute_monitors               = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] config_dir                     = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] config_drive_format            = iso9660 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] config_source                  = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] console_host                   = user {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] control_exchange               = nova {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cpu_allocation_ratio           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] daemon                         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] debug                          = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] default_access_ip_network_name = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] default_availability_zone      = nova {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] default_ephemeral_format       = ext4 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] default_green_pool_size        = 1000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] default_schedule_zone          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] disk_allocation_ratio          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] enable_new_services            = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] enabled_ssl_apis               = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] flat_injected                  = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] force_config_drive             = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] force_raw_images               = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] graceful_shutdown_timeout      = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] heal_instance_info_cache_interval = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] host                           = user {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_build_timeout         = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_delete_interval       = 300 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_name_template         = instance-%08x {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_usage_audit           = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_usage_audit_period    = month {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] internal_service_availability_zone = internal {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] key                            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] live_migration_retry_count     = 30 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_config_append              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_dir                        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_file                       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_options                    = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_rotate_interval            = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_rotate_interval_type       = days {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] log_rotation_type              = none {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] long_rpc_timeout               = 1800 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] max_concurrent_builds          = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] max_concurrent_live_migrations = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] max_concurrent_snapshots       = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] max_local_block_devices        = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] max_logfile_count              = 30 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] max_logfile_size_mb            = 200 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] maximum_instance_delete_attempts = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metadata_listen                = 0.0.0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metadata_listen_port           = 8775 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metadata_workers               = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] migrate_max_retries            = -1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] mkisofs_cmd                    = genisoimage {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] my_ip                          = 10.0.0.210 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] network_allocate_retries       = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] osapi_compute_listen_port      = 8774 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] osapi_compute_unique_server_name_scope =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] osapi_compute_workers          = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] password_length                = 12 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] periodic_enable                = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] periodic_fuzzy_delay           = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] pointer_model                  = ps2mouse {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] preallocate_images             = none {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] publish_errors                 = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] pybasedir                      = /opt/stack/nova {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ram_allocation_ratio           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rate_limit_burst               = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rate_limit_except_level        = CRITICAL {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rate_limit_interval            = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reboot_timeout                 = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reclaim_instance_interval      = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] record                         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reimage_timeout_per_gb         = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] report_interval                = 120 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rescue_timeout                 = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reserved_host_cpus             = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reserved_host_disk_mb          = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reserved_host_memory_mb        = 512 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] reserved_huge_pages            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] resize_confirm_window          = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] resize_fs_using_block_device   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] resume_guests_state_on_host_boot = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rpc_response_timeout           = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] run_external_periodic_tasks    = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] running_deleted_instance_action = reap {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] running_deleted_instance_timeout = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler_instance_sync_interval = 120 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_down_time              = 720 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] servicegroup_driver            = db {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] shelved_offload_time           = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] shelved_poll_interval          = 3600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] shutdown_timeout               = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] source_is_ipv6                 = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ssl_only                       = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] state_path                     = /opt/stack/data/nova {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] sync_power_state_interval      = 600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] sync_power_state_pool_size     = 1000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] syslog_log_facility            = LOG_USER {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] tempdir                        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] timeout_nbd                    = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] transport_url                  = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] update_resources_interval      = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_cow_images                 = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_eventlog                   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_journal                    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_json                       = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_rootwrap_daemon            = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_stderr                     = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] use_syslog                     = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vcpu_pin_set                   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plugging_is_fatal          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plugging_timeout           = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] virt_mkfs                      = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] volume_usage_poll_interval     = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] watch_log_file                 = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] web                            = /usr/share/spice-html5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_concurrency.disable_process_locking = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.auth_strategy              = keystone {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.compute_link_prefix        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.dhcp_domain                = novalocal {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.enable_instance_password   = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.glance_link_prefix         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.instance_list_per_project_cells = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.list_records_by_skipping_down_cells = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.local_metadata_per_cell    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.max_limit                  = 1000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.metadata_cache_expiration  = 15 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.neutron_default_tenant_id  = default {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.use_forwarded_for          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.use_neutron_default_nets   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_dynamic_targets = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_jsonfile_path   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.backend_argument         = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.config_prefix            = cache.oslo {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.dead_timeout             = 60.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.debug_cache_backend      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.enable_retry_client      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.enable_socket_keepalive  = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.enabled                  = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.expiration_time          = 600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.hashclient_retry_attempts = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_dead_retry      = 300 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_password        =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_sasl_enabled    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.memcache_username        =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.proxies                  = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.retry_attempts           = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.retry_delay              = 0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.socket_keepalive_count   = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.socket_keepalive_idle    = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.socket_keepalive_interval = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.tls_allowed_ciphers      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.tls_cafile               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.tls_certfile             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.tls_enabled              = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cache.tls_keyfile              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.auth_section            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.auth_type               = password {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.cafile                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.certfile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.collect_timing          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.cross_az_attach         = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.debug                   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.endpoint_template       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.http_retries            = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.insecure                = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.keyfile                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.os_region_name          = RegionOne {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.split_loggers           = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cinder.timeout                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.cpu_dedicated_set      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.cpu_shared_set         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.image_type_exclude_list = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.resource_provider_association_refresh = 300 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.shutdown_retry_interval = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] conductor.workers              = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] console.allowed_origins        = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] console.ssl_ciphers            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] console.ssl_minimum_version    = default {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] consoleauth.token_ttl          = 600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.cafile                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.certfile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.collect_timing          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.connect_retries         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.connect_retry_delay     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.endpoint_override       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.insecure                = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.keyfile                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.max_version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.min_version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.region_name             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.service_name            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.service_type            = accelerator {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.split_loggers           = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.status_code_retries     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.timeout                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] cyborg.version                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.backend               = sqlalchemy {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.connection            = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.connection_debug      = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.connection_parameters =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.connection_recycle_time = 3600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.connection_trace      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.db_inc_retry_interval = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.db_max_retries        = 20 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.db_max_retry_interval = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.db_retry_interval     = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.max_overflow          = 50 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.max_pool_size         = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.max_retries           = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.mysql_wsrep_sync_wait = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.pool_timeout          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.retry_interval        = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.slave_connection      = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] database.sqlite_synchronous    = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.backend           = sqlalchemy {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.connection        = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.connection_debug  = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.connection_parameters =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.connection_recycle_time = 3600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.connection_trace  = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.db_inc_retry_interval = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.db_max_retries    = 20 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.db_max_retry_interval = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.db_retry_interval = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.max_overflow      = 50 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.max_pool_size     = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.max_retries       = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.pool_timeout      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.retry_interval    = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.slave_connection  = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] api_database.sqlite_synchronous = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] devices.enabled_mdev_types     = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ephemeral_storage_encryption.enabled = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.api_servers             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.cafile                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.certfile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.collect_timing          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.connect_retries         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.connect_retry_delay     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.debug                   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.default_trusted_certificate_ids = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.enable_certificate_validation = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.enable_rbd_download     = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.endpoint_override       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.insecure                = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.keyfile                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.max_version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.min_version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.num_retries             = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.rbd_ceph_conf           =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.rbd_connect_timeout     = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.rbd_pool                =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.rbd_user                =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.region_name             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.service_name            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.service_type            = image {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.split_loggers           = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.status_code_retries     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.timeout                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.verify_glance_signatures = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] glance.version                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] guestfs.debug                  = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.config_drive_cdrom      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.config_drive_inject_password = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.enable_remotefx         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.instances_path_share    =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.limit_cpu_features      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.use_multipath_io        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.vswitch_name            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] mks.enabled                    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] image_cache.manager_interval   = 2400 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] image_cache.precache_concurrency = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] image_cache.remove_unused_base_images = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] image_cache.subdirectory_name  = _base {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.api_max_retries         = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.api_retry_interval      = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.auth_section            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.auth_type               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.cafile                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.certfile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.collect_timing          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.conductor_group         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.connect_retries         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.connect_retry_delay     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.endpoint_override       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.insecure                = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.keyfile                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.max_version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.min_version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.peer_list               = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.region_name             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.serial_console_state_timeout = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.service_name            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.service_type            = baremetal {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.split_loggers           = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.status_code_retries     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.timeout                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ironic.version                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] key_manager.fixed_key          = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.barbican_api_version  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.barbican_endpoint     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.barbican_endpoint_type = public {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.barbican_region_name  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.cafile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.certfile              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.collect_timing        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.insecure              = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.keyfile               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.number_of_retries     = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.retry_delay           = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.send_service_user_token = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.split_loggers         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.timeout               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.verify_ssl            = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican.verify_ssl_path       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.auth_section = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.auth_type = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.cafile   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.certfile = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.collect_timing = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.insecure = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.keyfile  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.split_loggers = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] barbican_service_user.timeout  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.approle_role_id          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.approle_secret_id        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.cafile                   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.certfile                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.collect_timing           = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.insecure                 = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.keyfile                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.kv_mountpoint            = secret {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.kv_path                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.kv_version               = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.namespace                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.root_token_id            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.split_loggers            = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.ssl_ca_crt_file          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.timeout                  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.use_ssl                  = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.auth_section          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.auth_type             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.cafile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.certfile              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.collect_timing        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.connect_retries       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.connect_retry_delay   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.endpoint_override     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.insecure              = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.keyfile               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.max_version           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.min_version           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.region_name           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.service_name          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.service_type          = identity {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.split_loggers         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.status_code_retries   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.timeout               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] keystone.version               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.connection_uri         =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_mode               = custom {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: WARNING oslo_config.cfg [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_power_governor_high = performance {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_power_management   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.device_detach_attempts = 8 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.device_detach_timeout  = 20 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.disk_cachemodes        = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.disk_prefix            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.enabled_perf_events    = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.file_backed_memory     = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.gid_maps               = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.hw_disk_discard        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.hw_machine_type        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_rbd_pool        = rbd {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_type            = default {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.images_volume_group    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.inject_key             = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.inject_partition       = -2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.inject_password        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.iscsi_iface            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.iser_use_multipath     = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_downtime = 500 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_inbound_addr = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_scheme  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_timeout_action = abort {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_tunnelled = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: WARNING oslo_config.cfg [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 19 14:43:44 user nova-compute[74934]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 19 14:43:44 user nova-compute[74934]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 19 14:43:44 user nova-compute[74934]: and ``live_migration_inbound_addr`` respectively.
Nov 19 14:43:44 user nova-compute[74934]: ).  Its value may be silently ignored in the future.
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.live_migration_with_native_tls = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.max_queues             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.nfs_mount_options      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.num_pcie_ports         = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.pmem_namespaces        = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.quobyte_client_cfg     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rbd_secret_uuid        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rbd_user               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rescue_image_id        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rescue_kernel_id       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.rx_queue_size          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.smbfs_mount_options    =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.snapshot_compression   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.snapshot_image_format  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.sparse_logical_volumes = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.swtpm_enabled          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.swtpm_group            = tss {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.swtpm_user             = tss {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.sysinfo_serial         = unique {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.tb_cache_size          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.tx_queue_size          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.uid_maps               = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.use_virtio_for_bridges = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.virt_type              = kvm {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.volume_clear           = zero {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.volume_clear_size      = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.volume_use_multipath   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_cache_path   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.auth_section           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.auth_type              = password {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.cafile                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.certfile               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.collect_timing         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.connect_retries        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.connect_retry_delay    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.default_floating_pool  = public {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.endpoint_override      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.extension_sync_interval = 600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.http_retries           = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.insecure               = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.keyfile                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.max_version            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.min_version            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.ovs_bridge             = br-int {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.physnets               = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.region_name            = RegionOne {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.service_metadata_proxy = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.service_name           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.service_type           = network {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.split_loggers          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.status_code_retries    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.timeout                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] neutron.version                = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] notifications.bdms_in_notifications = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] notifications.default_level    = INFO {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] notifications.notification_format = unversioned {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] notifications.notify_on_state_change = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] pci.alias                      = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] pci.device_spec                = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] pci.report_in_placement        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.auth_section         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.auth_type            = password {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.cafile               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.certfile             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.collect_timing       = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.connect_retries      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.connect_retry_delay  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.default_domain_id    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.default_domain_name  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.domain_id            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.domain_name          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.endpoint_override    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.insecure             = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.keyfile              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.max_version          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.min_version          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.password             = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.project_domain_id    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.project_domain_name  = Default {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.project_id           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.project_name         = service {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.region_name          = RegionOne {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.service_name         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.service_type         = placement {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.split_loggers        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.status_code_retries  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.system_scope         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.timeout              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.trust_id             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.user_domain_id       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.user_domain_name     = Default {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.user_id              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.username             = placement {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] placement.version              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.cores                    = 20 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.count_usage_from_placement = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.injected_file_content_bytes = 10240 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.injected_file_path_length = 255 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.injected_files           = 5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.instances                = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.key_pairs                = 100 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.metadata_items           = 128 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.ram                      = 51200 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.recheck_quota            = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.server_group_members     = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] quota.server_groups            = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rdp.enabled                    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.image_metadata_prefilter = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.max_attempts         = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.max_placement_results = 1000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] scheduler.workers              = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.host_subset_size = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.isolated_hosts = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.isolated_images = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.pci_in_placement = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.track_instance_changes = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metrics.required               = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metrics.weight_multiplier      = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] metrics.weight_setting         = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] serial_console.enabled         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] serial_console.port_range      = 10000:20000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] serial_console.serialproxy_port = 6083 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.auth_section      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.auth_type         = password {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.cafile            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.certfile          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.collect_timing    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.insecure          = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.keyfile           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.send_service_user_token = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.split_loggers     = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] service_user.timeout           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.agent_enabled            = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.enabled                  = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.html5proxy_port          = 6082 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.image_compression        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.jpeg_compression         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.playback_compression     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.server_listen            = 127.0.0.1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.streaming_mode           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] spice.zlib_compression         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] upgrade_levels.baseapi         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] upgrade_levels.compute         = auto {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] upgrade_levels.conductor       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] upgrade_levels.scheduler       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.cafile = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.certfile = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.insecure = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vendordata_dynamic_auth.timeout = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.api_retry_count         = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.ca_file                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.cache_prefix            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.cluster_name            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.connection_pool_size    = 10 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.console_delay_seconds   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.datastore_regex         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.host_ip                 = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.host_password           = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.host_port               = 443 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.host_username           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.insecure                = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.integration_bridge      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.maximum_objects         = 100 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.pbm_default_policy      = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.pbm_enabled             = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.pbm_wsdl_location       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.serial_port_proxy_uri   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.serial_port_service_uri = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.task_poll_interval      = 0.5 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.use_linked_clone        = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.vnc_keymap              = en-us {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.vnc_port                = 5900 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vmware.vnc_port_total          = 10000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.auth_schemes               = ['none'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.enabled                    = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.novncproxy_port            = 6080 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.vencrypt_ca_certs          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.vencrypt_client_cert       = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vnc.vencrypt_client_key        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.disable_rootwrap   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.enable_numa_live_migration = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.libvirt_disable_apic = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.client_socket_timeout     = 900 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.default_pool_size         = 1000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.keep_alive                = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.max_header_line           = 16384 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.ssl_ca_file               = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.ssl_cert_file             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.ssl_key_file              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.tcp_keepidle              = 600 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] zvm.ca_file                    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] zvm.cloud_connector_url        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] zvm.reachable_timeout          = 300 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.enforce_new_defaults = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.enforce_scope      = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.policy_default_rule = default {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.connection_string     = messaging:// {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.enabled               = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.es_doc_type           = notification {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.es_scroll_size        = 10000 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.es_scroll_time        = 2m {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:44 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.filter_error_trace    = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.hmac_keys             = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.sentinel_service_name = mymaster {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.socket_timeout        = 0.1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.trace_requests        = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler.trace_sqlalchemy      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler_jaeger.process_tags   = {} {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler_jaeger.service_name_prefix = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] profiler_otlp.service_name_prefix = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] remote_debug.host              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] remote_debug.port              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_notifications.retry = -1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.auth_section        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.auth_type           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.cafile              = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.certfile            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.collect_timing      = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.connect_retries     = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.connect_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.endpoint_id         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.endpoint_override   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.insecure            = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.keyfile             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.max_version         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.min_version         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.region_name         = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.service_name        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.service_type        = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.split_loggers       = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.status_code_retries = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.status_code_retry_delay = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.timeout             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.valid_interfaces    = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_limit.version             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_reports.file_event_handler = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] oslo_reports.log_dir           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_ovs_privileged.group  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] vif_plug_ovs_privileged.user   = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.isolate_vif         = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] os_brick.lock_path             = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] privsep_osbrick.capabilities   = [21] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] privsep_osbrick.group          = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] privsep_osbrick.helper_command = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] privsep_osbrick.user           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] nova_sys_admin.group           = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] nova_sys_admin.helper_command  = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] nova_sys_admin.user            = None {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG oslo_service.service [None req-c430b728-0298-4ed4-849f-0ca379521672 None None] ******************************************************************************** {{(pid=74934) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 19 14:43:45 user nova-compute[74934]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Connecting to libvirt: qemu:///system {{(pid=74934) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f13e4ee23b0> {{(pid=74934) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 19 14:43:45 user nova-compute[74934]: libvirt:  error : internal error: could not initialize domain event timer
Nov 19 14:43:45 user nova-compute[74934]: WARNING nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f13e4ee23b0> {{(pid=74934) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Starting native event thread {{(pid=74934) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Starting green dispatch thread {{(pid=74934) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Starting connection event dispatch thread {{(pid=74934) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 19 14:43:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Connection event '1' reason 'None'
Nov 19 14:43:45 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 19 14:43:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.mount [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Initialising _HostMountState generation 0 {{(pid=74934) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 19 14:43:52 user nova-compute[74934]: INFO nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host capabilities <capabilities>
Nov 19 14:43:52 user nova-compute[74934]:   <host>
Nov 19 14:43:52 user nova-compute[74934]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 19 14:43:52 user nova-compute[74934]:     <cpu>
Nov 19 14:43:52 user nova-compute[74934]:       <arch>x86_64</arch>
Nov 19 14:43:52 user nova-compute[74934]:       <model>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:52 user nova-compute[74934]:       <microcode version='1070'/>
Nov 19 14:43:52 user nova-compute[74934]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 19 14:43:52 user nova-compute[74934]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='ss'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='vmx'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='pcid'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='osxsave'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='hypervisor'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='arat'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='tsc_adjust'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='md-clear'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='arch-capabilities'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='invtsc'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='rsba'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature name='skip-l1dfl-vmentry'/>
Nov 19 14:43:52 user nova-compute[74934]:       <pages unit='KiB' size='4'/>
Nov 19 14:43:52 user nova-compute[74934]:       <pages unit='KiB' size='2048'/>
Nov 19 14:43:52 user nova-compute[74934]:     </cpu>
Nov 19 14:43:52 user nova-compute[74934]:     <power_management>
Nov 19 14:43:52 user nova-compute[74934]:       <suspend_mem/>
Nov 19 14:43:52 user nova-compute[74934]:       <suspend_disk/>
Nov 19 14:43:52 user nova-compute[74934]:       <suspend_hybrid/>
Nov 19 14:43:52 user nova-compute[74934]:     </power_management>
Nov 19 14:43:52 user nova-compute[74934]:     <iommu support='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     <migration_features>
Nov 19 14:43:52 user nova-compute[74934]:       <live/>
Nov 19 14:43:52 user nova-compute[74934]:       <uri_transports>
Nov 19 14:43:52 user nova-compute[74934]:         <uri_transport>tcp</uri_transport>
Nov 19 14:43:52 user nova-compute[74934]:         <uri_transport>rdma</uri_transport>
Nov 19 14:43:52 user nova-compute[74934]:       </uri_transports>
Nov 19 14:43:52 user nova-compute[74934]:     </migration_features>
Nov 19 14:43:52 user nova-compute[74934]:     <topology>
Nov 19 14:43:52 user nova-compute[74934]:       <cells num='2'>
Nov 19 14:43:52 user nova-compute[74934]:         <cell id='0'>
Nov 19 14:43:52 user nova-compute[74934]:           <memory unit='KiB'>8140616</memory>
Nov 19 14:43:52 user nova-compute[74934]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 19 14:43:52 user nova-compute[74934]:           <pages unit='KiB' size='2048'>0</pages>
Nov 19 14:43:52 user nova-compute[74934]:           <distances>
Nov 19 14:43:52 user nova-compute[74934]:             <sibling id='0' value='10'/>
Nov 19 14:43:52 user nova-compute[74934]:             <sibling id='1' value='20'/>
Nov 19 14:43:52 user nova-compute[74934]:           </distances>
Nov 19 14:43:52 user nova-compute[74934]:           <cpus num='6'>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 19 14:43:52 user nova-compute[74934]:           </cpus>
Nov 19 14:43:52 user nova-compute[74934]:         </cell>
Nov 19 14:43:52 user nova-compute[74934]:         <cell id='1'>
Nov 19 14:43:52 user nova-compute[74934]:           <memory unit='KiB'>8255100</memory>
Nov 19 14:43:52 user nova-compute[74934]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 19 14:43:52 user nova-compute[74934]:           <pages unit='KiB' size='2048'>0</pages>
Nov 19 14:43:52 user nova-compute[74934]:           <distances>
Nov 19 14:43:52 user nova-compute[74934]:             <sibling id='0' value='20'/>
Nov 19 14:43:52 user nova-compute[74934]:             <sibling id='1' value='10'/>
Nov 19 14:43:52 user nova-compute[74934]:           </distances>
Nov 19 14:43:52 user nova-compute[74934]:           <cpus num='6'>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 19 14:43:52 user nova-compute[74934]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 19 14:43:52 user nova-compute[74934]:           </cpus>
Nov 19 14:43:52 user nova-compute[74934]:         </cell>
Nov 19 14:43:52 user nova-compute[74934]:       </cells>
Nov 19 14:43:52 user nova-compute[74934]:     </topology>
Nov 19 14:43:52 user nova-compute[74934]:     <cache>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 19 14:43:52 user nova-compute[74934]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 19 14:43:52 user nova-compute[74934]:     </cache>
Nov 19 14:43:52 user nova-compute[74934]:     <secmodel>
Nov 19 14:43:52 user nova-compute[74934]:       <model>apparmor</model>
Nov 19 14:43:52 user nova-compute[74934]:       <doi>0</doi>
Nov 19 14:43:52 user nova-compute[74934]:     </secmodel>
Nov 19 14:43:52 user nova-compute[74934]:     <secmodel>
Nov 19 14:43:52 user nova-compute[74934]:       <model>dac</model>
Nov 19 14:43:52 user nova-compute[74934]:       <doi>0</doi>
Nov 19 14:43:52 user nova-compute[74934]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 19 14:43:52 user nova-compute[74934]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 19 14:43:52 user nova-compute[74934]:     </secmodel>
Nov 19 14:43:52 user nova-compute[74934]:   </host>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='alpha'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>clipper</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='armv6l'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>integratorcp</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>borzoi</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>spitz</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>nuri</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>musca-b1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>versatileab</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>kzm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>musca-a</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>smdkc210</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sx1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>z2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>tosa</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>sabrelite</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>realview-eb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>n810</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>n800</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>versatilepb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>terrier</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mainstone</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>midway</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>musicpal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>microbit</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>cubieboard</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>verdex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>netduino2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>raspi2b</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>cheetah</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>highbank</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>akita</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>connex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>collie</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>raspi0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='armv7l'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>integratorcp</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>borzoi</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>spitz</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>nuri</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>musca-b1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>versatileab</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>kzm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>musca-a</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>smdkc210</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sx1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>z2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>tosa</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>sabrelite</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>realview-eb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>n810</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>n800</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>versatilepb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>terrier</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mainstone</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>midway</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>musicpal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>microbit</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>cubieboard</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>verdex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>netduino2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>raspi2b</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>cheetah</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>highbank</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>akita</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>connex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>collie</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>raspi0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='aarch64'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>integratorcp</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>borzoi</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>spitz</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>nuri</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>musca-b1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>versatileab</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>kzm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>musca-a</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>smdkc210</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sx1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>z2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>tosa</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>sabrelite</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>realview-eb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>n810</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>n800</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>versatilepb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>terrier</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mainstone</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>midway</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>musicpal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>microbit</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>cubieboard</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>verdex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>netduino2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>raspi3b</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>raspi2b</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>cheetah</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>highbank</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>akita</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>connex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>collie</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>raspi0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <acpi default='on' toggle='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='cris'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='i686'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>x-remote</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>isapc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>microvm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='kvm'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <pae/>
Nov 19 14:43:52 user nova-compute[74934]:       <nonpae/>
Nov 19 14:43:52 user nova-compute[74934]:       <acpi default='on' toggle='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:       <apic default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='m68k'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>an5206</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>q800</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>next-cube</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='microblaze'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='microblazeel'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='mips'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='16'>malta</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mipssim</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='mipsel'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='16'>malta</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mipssim</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='mips64'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='16'>malta</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mipssim</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>pica61</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>magnum</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='mips64el'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='16'>malta</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mipssim</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>pica61</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>magnum</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='16'>boston</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='ppc'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>g3beige</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mac99</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ppce500</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>pegasos2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sam460ex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>bamboo</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>40p</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>ref405ep</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>taihu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='ppc64'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2048'>powernv9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>taihu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2048'>powernv10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ppce500</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>40p</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>pegasos2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>bamboo</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>g3beige</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mac99</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sam460ex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>ref405ep</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2048'>powernv8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='ppc64le'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2048'>powernv9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>taihu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2048'>powernv10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ppce500</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>40p</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>pegasos2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>bamboo</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>g3beige</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>mac99</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sam460ex</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>ref405ep</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2048'>powernv8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='riscv32'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='8'>spike</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>opentitan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='5'>sifive_u</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sifive_e</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='8'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='riscv64'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='8'>spike</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='5'>sifive_u</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>shakti_c</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sifive_e</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='8'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='s390x'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='sh4'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>shix</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>r2d</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='sh4eb'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>shix</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>r2d</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='sparc'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>SS-5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>SS-20</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>LX</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>SS-4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>SS-10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>Voyager</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='sparc64'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sun4u</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>niagara</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>sun4v</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='x86_64'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>64</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>x-remote</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='1'>isapc</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>microvm</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='kvm'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <acpi default='on' toggle='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:       <apic default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='xtensa'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>sim</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>kc705</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ml605</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx200</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx60</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]:   <guest>
Nov 19 14:43:52 user nova-compute[74934]:     <os_type>hvm</os_type>
Nov 19 14:43:52 user nova-compute[74934]:     <arch name='xtensaeb'>
Nov 19 14:43:52 user nova-compute[74934]:       <wordsize>32</wordsize>
Nov 19 14:43:52 user nova-compute[74934]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='4'>sim</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>kc705</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ml605</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>virt</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx200</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>lx60</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 19 14:43:52 user nova-compute[74934]:       <domain type='qemu'/>
Nov 19 14:43:52 user nova-compute[74934]:     </arch>
Nov 19 14:43:52 user nova-compute[74934]:     <features>
Nov 19 14:43:52 user nova-compute[74934]:       <cpuselection/>
Nov 19 14:43:52 user nova-compute[74934]:       <deviceboot/>
Nov 19 14:43:52 user nova-compute[74934]:       <disksnapshot default='on' toggle='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     </features>
Nov 19 14:43:52 user nova-compute[74934]:   </guest>
Nov 19 14:43:52 user nova-compute[74934]: </capabilities>
Nov 19 14:43:52 user nova-compute[74934]: 
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 19 14:43:52 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:   <path>/usr/bin/qemu-system-i386</path>
Nov 19 14:43:52 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:52 user nova-compute[74934]:   <machine>pc-q35-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:   <arch>i686</arch>
Nov 19 14:43:52 user nova-compute[74934]:   <vcpu max='288'/>
Nov 19 14:43:52 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='firmware'/>
Nov 19 14:43:52 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </loader>
Nov 19 14:43:52 user nova-compute[74934]:   </os>
Nov 19 14:43:52 user nova-compute[74934]:   <cpu>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='lm'/>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>kvm64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>core2duo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Penryn</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G1</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Conroe</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:   </cpu>
Nov 19 14:43:52 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:52 user nova-compute[74934]:     </enum>
Nov 19 14:43:52 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:52 user nova-compute[74934]:   <devices>
Nov 19 14:43:52 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </disk>
Nov 19 14:43:52 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </graphics>
Nov 19 14:43:52 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </video>
Nov 19 14:43:52 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:52 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:52 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </rng>
Nov 19 14:43:52 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:52 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </tpm>
Nov 19 14:43:52 user nova-compute[74934]:   </devices>
Nov 19 14:43:52 user nova-compute[74934]:   <features>
Nov 19 14:43:52 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:   </features>
Nov 19 14:43:52 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 19 14:43:52 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:   <path>/usr/bin/qemu-system-i386</path>
Nov 19 14:43:52 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:52 user nova-compute[74934]:   <machine>pc-q35-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:   <arch>i686</arch>
Nov 19 14:43:52 user nova-compute[74934]:   <vcpu max='288'/>
Nov 19 14:43:52 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='firmware'/>
Nov 19 14:43:52 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </loader>
Nov 19 14:43:52 user nova-compute[74934]:   </os>
Nov 19 14:43:52 user nova-compute[74934]:   <cpu>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='lm'/>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>kvm64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>core2duo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Penryn</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G1</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Conroe</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:   </cpu>
Nov 19 14:43:52 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:52 user nova-compute[74934]:     </enum>
Nov 19 14:43:52 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:52 user nova-compute[74934]:   <devices>
Nov 19 14:43:52 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </disk>
Nov 19 14:43:52 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </graphics>
Nov 19 14:43:52 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </video>
Nov 19 14:43:52 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:52 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:52 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </rng>
Nov 19 14:43:52 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:52 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </tpm>
Nov 19 14:43:52 user nova-compute[74934]:   </devices>
Nov 19 14:43:52 user nova-compute[74934]:   <features>
Nov 19 14:43:52 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:   </features>
Nov 19 14:43:52 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 19 14:43:52 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:   <path>/usr/bin/qemu-system-i386</path>
Nov 19 14:43:52 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:52 user nova-compute[74934]:   <machine>pc-i440fx-6.2</machine>
Nov 19 14:43:52 user nova-compute[74934]:   <arch>i686</arch>
Nov 19 14:43:52 user nova-compute[74934]:   <vcpu max='255'/>
Nov 19 14:43:52 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='firmware'/>
Nov 19 14:43:52 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </loader>
Nov 19 14:43:52 user nova-compute[74934]:   </os>
Nov 19 14:43:52 user nova-compute[74934]:   <cpu>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='lm'/>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>kvm64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>core2duo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Penryn</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G1</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Conroe</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:   </cpu>
Nov 19 14:43:52 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:52 user nova-compute[74934]:     </enum>
Nov 19 14:43:52 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:52 user nova-compute[74934]:   <devices>
Nov 19 14:43:52 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>ide</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </disk>
Nov 19 14:43:52 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </graphics>
Nov 19 14:43:52 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </video>
Nov 19 14:43:52 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:52 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:52 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </rng>
Nov 19 14:43:52 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:52 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </tpm>
Nov 19 14:43:52 user nova-compute[74934]:   </devices>
Nov 19 14:43:52 user nova-compute[74934]:   <features>
Nov 19 14:43:52 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:   </features>
Nov 19 14:43:52 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 19 14:43:52 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:   <path>/usr/bin/qemu-system-i386</path>
Nov 19 14:43:52 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:52 user nova-compute[74934]:   <machine>pc-i440fx-jammy</machine>
Nov 19 14:43:52 user nova-compute[74934]:   <arch>i686</arch>
Nov 19 14:43:52 user nova-compute[74934]:   <vcpu max='255'/>
Nov 19 14:43:52 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='firmware'/>
Nov 19 14:43:52 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </loader>
Nov 19 14:43:52 user nova-compute[74934]:   </os>
Nov 19 14:43:52 user nova-compute[74934]:   <cpu>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:52 user nova-compute[74934]:       <feature policy='disable' name='lm'/>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>kvm64</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>core2duo</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Westmere</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Penryn</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Opteron_G1</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Nehalem</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Conroe</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:52 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:52 user nova-compute[74934]:     </mode>
Nov 19 14:43:52 user nova-compute[74934]:   </cpu>
Nov 19 14:43:52 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:52 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:52 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:52 user nova-compute[74934]:     </enum>
Nov 19 14:43:52 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:52 user nova-compute[74934]:   <devices>
Nov 19 14:43:52 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>ide</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </disk>
Nov 19 14:43:52 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </graphics>
Nov 19 14:43:52 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </video>
Nov 19 14:43:52 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:52 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:52 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </rng>
Nov 19 14:43:52 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:52 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:52 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:52 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:52 user nova-compute[74934]:       </enum>
Nov 19 14:43:52 user nova-compute[74934]:     </tpm>
Nov 19 14:43:52 user nova-compute[74934]:   </devices>
Nov 19 14:43:52 user nova-compute[74934]:   <features>
Nov 19 14:43:52 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:52 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:52 user nova-compute[74934]:   </features>
Nov 19 14:43:52 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:52 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 19 14:43:53 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 19 14:43:53 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:53 user nova-compute[74934]:   <machine>pc-q35-jammy</machine>
Nov 19 14:43:53 user nova-compute[74934]:   <arch>x86_64</arch>
Nov 19 14:43:53 user nova-compute[74934]:   <vcpu max='288'/>
Nov 19 14:43:53 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='firmware'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>efi</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </loader>
Nov 19 14:43:53 user nova-compute[74934]:   </os>
Nov 19 14:43:53 user nova-compute[74934]:   <cpu>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='invtsc'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='rsba'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pschange-mc-no'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>core2duo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Penryn</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Opteron_G1</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Conroe</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:   </cpu>
Nov 19 14:43:53 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:53 user nova-compute[74934]:   <devices>
Nov 19 14:43:53 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </disk>
Nov 19 14:43:53 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </graphics>
Nov 19 14:43:53 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </video>
Nov 19 14:43:53 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:53 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:53 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </rng>
Nov 19 14:43:53 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:53 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </tpm>
Nov 19 14:43:53 user nova-compute[74934]:   </devices>
Nov 19 14:43:53 user nova-compute[74934]:   <features>
Nov 19 14:43:53 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:   </features>
Nov 19 14:43:53 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 19 14:43:53 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 19 14:43:53 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:53 user nova-compute[74934]:   <machine>pc-q35-6.2</machine>
Nov 19 14:43:53 user nova-compute[74934]:   <arch>x86_64</arch>
Nov 19 14:43:53 user nova-compute[74934]:   <vcpu max='288'/>
Nov 19 14:43:53 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='firmware'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>efi</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </loader>
Nov 19 14:43:53 user nova-compute[74934]:   </os>
Nov 19 14:43:53 user nova-compute[74934]:   <cpu>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='invtsc'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='rsba'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pschange-mc-no'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>core2duo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Penryn</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Opteron_G1</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Conroe</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:   </cpu>
Nov 19 14:43:53 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:53 user nova-compute[74934]:   <devices>
Nov 19 14:43:53 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </disk>
Nov 19 14:43:53 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </graphics>
Nov 19 14:43:53 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </video>
Nov 19 14:43:53 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:53 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:53 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </rng>
Nov 19 14:43:53 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:53 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </tpm>
Nov 19 14:43:53 user nova-compute[74934]:   </devices>
Nov 19 14:43:53 user nova-compute[74934]:   <features>
Nov 19 14:43:53 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:   </features>
Nov 19 14:43:53 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 19 14:43:53 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 19 14:43:53 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:53 user nova-compute[74934]:   <machine>pc-i440fx-6.2</machine>
Nov 19 14:43:53 user nova-compute[74934]:   <arch>x86_64</arch>
Nov 19 14:43:53 user nova-compute[74934]:   <vcpu max='255'/>
Nov 19 14:43:53 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='firmware'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>efi</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </loader>
Nov 19 14:43:53 user nova-compute[74934]:   </os>
Nov 19 14:43:53 user nova-compute[74934]:   <cpu>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='invtsc'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='rsba'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pschange-mc-no'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>core2duo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Penryn</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Opteron_G1</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Conroe</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:   </cpu>
Nov 19 14:43:53 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:53 user nova-compute[74934]:   <devices>
Nov 19 14:43:53 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>ide</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </disk>
Nov 19 14:43:53 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </graphics>
Nov 19 14:43:53 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </video>
Nov 19 14:43:53 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:53 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:53 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </rng>
Nov 19 14:43:53 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:53 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </tpm>
Nov 19 14:43:53 user nova-compute[74934]:   </devices>
Nov 19 14:43:53 user nova-compute[74934]:   <features>
Nov 19 14:43:53 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:   </features>
Nov 19 14:43:53 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 19 14:43:53 user nova-compute[74934]: <domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 19 14:43:53 user nova-compute[74934]:   <domain>kvm</domain>
Nov 19 14:43:53 user nova-compute[74934]:   <machine>pc-i440fx-jammy</machine>
Nov 19 14:43:53 user nova-compute[74934]:   <arch>x86_64</arch>
Nov 19 14:43:53 user nova-compute[74934]:   <vcpu max='255'/>
Nov 19 14:43:53 user nova-compute[74934]:   <iothreads supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:   <os supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='firmware'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>efi</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:     <loader supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>rom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pflash</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='readonly'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>yes</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='secure'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>no</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </loader>
Nov 19 14:43:53 user nova-compute[74934]:   </os>
Nov 19 14:43:53 user nova-compute[74934]:   <cpu>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-passthrough' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='hostPassthroughMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='maximum' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='maximumMigratable'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>on</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>off</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='host-model' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <vendor>Intel</vendor>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ss'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='vmx'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pcid'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='hypervisor'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arat'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='tsc_adjust'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='umip'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='md-clear'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='arch-capabilities'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='invtsc'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibpb'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='ibrs'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-stibp'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='amd-ssbd'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='rsba'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='require' name='pschange-mc-no'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='erms'/>
Nov 19 14:43:53 user nova-compute[74934]:       <feature policy='disable' name='xsaveopt'/>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:     <mode name='custom' supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>qemu64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>qemu32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>phenom</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>pentium</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>n270</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm64</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>kvm32</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>coreduo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>core2duo</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>athlon</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Westmere</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Snowridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Skylake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>SandyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Penryn</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G5</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G4</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G3</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Opteron_G2</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Opteron_G1</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Nehalem</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>IvyBridge</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Icelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Haswell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Rome</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-Milan</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC-IBPB</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>EPYC</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Dhyana</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cooperlake</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>Conroe</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Cascadelake-Server</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-noTSX</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell-IBRS</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='no'>Broadwell</model>
Nov 19 14:43:53 user nova-compute[74934]:       <model usable='yes'>486</model>
Nov 19 14:43:53 user nova-compute[74934]:     </mode>
Nov 19 14:43:53 user nova-compute[74934]:   </cpu>
Nov 19 14:43:53 user nova-compute[74934]:   <memoryBacking supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:     <enum name='sourceType'>
Nov 19 14:43:53 user nova-compute[74934]:       <value>file</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>anonymous</value>
Nov 19 14:43:53 user nova-compute[74934]:       <value>memfd</value>
Nov 19 14:43:53 user nova-compute[74934]:     </enum>
Nov 19 14:43:53 user nova-compute[74934]:   </memoryBacking>
Nov 19 14:43:53 user nova-compute[74934]:   <devices>
Nov 19 14:43:53 user nova-compute[74934]:     <disk supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='diskDevice'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>disk</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cdrom</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>floppy</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>lun</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='bus'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>ide</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>fdc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sata</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </disk>
Nov 19 14:43:53 user nova-compute[74934]:     <graphics supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='type'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>sdl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vnc</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>spice</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egl-headless</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </graphics>
Nov 19 14:43:53 user nova-compute[74934]:     <video supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='modelType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>cirrus</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>vmvga</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>qxl</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>none</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>bochs</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>ramfb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </video>
Nov 19 14:43:53 user nova-compute[74934]:     <hostdev supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='mode'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>subsystem</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='startupPolicy'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>default</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>mandatory</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>requisite</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>optional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='subsysType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>usb</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>pci</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>scsi</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='capsType'/>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='pciBackend'/>
Nov 19 14:43:53 user nova-compute[74934]:     </hostdev>
Nov 19 14:43:53 user nova-compute[74934]:     <rng supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtio-non-transitional</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>random</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>egd</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>builtin</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </rng>
Nov 19 14:43:53 user nova-compute[74934]:     <filesystem supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='driverType'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>path</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>handle</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>virtiofs</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </filesystem>
Nov 19 14:43:53 user nova-compute[74934]:     <tpm supported='yes'>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='model'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-tis</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>tpm-crb</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:       <enum name='backendModel'>
Nov 19 14:43:53 user nova-compute[74934]:         <value>passthrough</value>
Nov 19 14:43:53 user nova-compute[74934]:         <value>emulator</value>
Nov 19 14:43:53 user nova-compute[74934]:       </enum>
Nov 19 14:43:53 user nova-compute[74934]:     </tpm>
Nov 19 14:43:53 user nova-compute[74934]:   </devices>
Nov 19 14:43:53 user nova-compute[74934]:   <features>
Nov 19 14:43:53 user nova-compute[74934]:     <gic supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:     <vmcoreinfo supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <genid supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backingStoreInput supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <backup supported='yes'/>
Nov 19 14:43:53 user nova-compute[74934]:     <sev supported='no'/>
Nov 19 14:43:53 user nova-compute[74934]:   </features>
Nov 19 14:43:53 user nova-compute[74934]: </domainCapabilities>
Nov 19 14:43:53 user nova-compute[74934]:  {{(pid=74934) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74934) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74934) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Checking secure boot support for host arch (x86_64) {{(pid=74934) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Secure Boot support detected
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] cpu compare xml: <cpu match="exact">
Nov 19 14:43:53 user nova-compute[74934]:   <model>Nehalem</model>
Nov 19 14:43:53 user nova-compute[74934]: </cpu>
Nov 19 14:43:53 user nova-compute[74934]:  {{(pid=74934) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.virt.node [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Generated node identity a6d80b64-40fb-4268-950b-1de97ecbab67
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.virt.node [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Wrote node identity a6d80b64-40fb-4268-950b-1de97ecbab67 to /opt/stack/data/nova/compute_id
Nov 19 14:43:53 user nova-compute[74934]: WARNING nova.compute.manager [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Compute nodes ['a6d80b64-40fb-4268-950b-1de97ecbab67'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.compute.manager [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 19 14:43:53 user nova-compute[74934]: WARNING nova.compute.manager [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 19 14:43:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:43:53 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:43:53 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Hypervisor/Node resource view: name=user free_ram=11002MB free_disk=26.192485809326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:43:53 user nova-compute[74934]: WARNING nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] No compute node record for user:a6d80b64-40fb-4268-950b-1de97ecbab67: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a6d80b64-40fb-4268-950b-1de97ecbab67 could not be found.
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Compute node record created for user:user with uuid: a6d80b64-40fb-4268-950b-1de97ecbab67
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] [req-44eed444-51d8-4620-ae69-4415401f272c] Created resource provider record via placement API for resource provider with UUID a6d80b64-40fb-4268-950b-1de97ecbab67 and name user.
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74934) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 19 14:43:53 user nova-compute[74934]: INFO nova.virt.libvirt.host [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] kernel doesn't support AMD SEV
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Libvirt baseline CPU <cpu>
Nov 19 14:43:53 user nova-compute[74934]:   <arch>x86_64</arch>
Nov 19 14:43:53 user nova-compute[74934]:   <model>Nehalem</model>
Nov 19 14:43:53 user nova-compute[74934]:   <vendor>Intel</vendor>
Nov 19 14:43:53 user nova-compute[74934]:   <topology sockets="6" cores="1" threads="1"/>
Nov 19 14:43:53 user nova-compute[74934]: </cpu>
Nov 19 14:43:53 user nova-compute[74934]:  {{(pid=74934) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Updated inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Updating resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 generation from 0 to 1 during operation: update_inventory {{(pid=74934) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 19 14:43:53 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 14:43:54 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Updating resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 generation from 1 to 2 during operation: update_traits {{(pid=74934) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 19 14:43:54 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:43:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:43:54 user nova-compute[74934]: DEBUG nova.service [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Creating RPC server for service compute {{(pid=74934) start /opt/stack/nova/nova/service.py:182}}
Nov 19 14:43:54 user nova-compute[74934]: DEBUG nova.service [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] Join ServiceGroup membership for this service compute {{(pid=74934) start /opt/stack/nova/nova/service.py:199}}
Nov 19 14:43:54 user nova-compute[74934]: DEBUG nova.servicegroup.drivers.db [None req-e7ec10a4-15e4-4a19-aac5-2bc3e01ded59 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74934) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 19 14:44:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:44:44 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:44:44 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=10448MB free_disk=26.09634780883789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:44:44 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:44:45 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:44:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:45:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:45:45 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:45:45 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=10366MB free_disk=26.16278076171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 14:45:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 14:45:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:45:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:45 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:45 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:46:46 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:46:46 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=10367MB free_disk=25.915298461914062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:46:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:46:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:46:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:45 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:45 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:47:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:47:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 14:47:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 14:47:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:47:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:47:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:47:48 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9691MB free_disk=25.94208526611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:47:48 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:47:49 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:47:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:47:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:47:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:47:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:47:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:47:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:47:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:47:59 user nova-compute[74934]: INFO nova.compute.claims [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Claim successful on node user
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Creating image(s)
Nov 19 14:48:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.policy [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdbd678512a7438bac9bc337a0d94ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de5bebd7613411cb782d31ed1884da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.virt.images [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] 010d533e-05ed-478e-9adb-00e830e2c77e was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.part /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:01 user nova-compute[74934]: INFO nova.compute.claims [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Claim successful on node user
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.part /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.converted" returned: 0 in 0.333s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.162s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:01 user nova-compute[74934]: INFO oslo.privsep.daemon [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph0ssqr7q/privsep.sock']
Nov 19 14:48:01 user sudo[84196]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph0ssqr7q/privsep.sock
Nov 19 14:48:01 user sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.policy [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77319d6b70b24f22b39342f6955a8fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2d42525428465c90522337ec5a4b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Creating image(s)
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "/opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "/opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "/opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:02 user nova-compute[74934]: INFO nova.compute.claims [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Claim successful on node user
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.360s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:02 user nova-compute[74934]: INFO nova.compute.claims [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Claim successful on node user
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Creating image(s)
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.policy [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdbd678512a7438bac9bc337a0d94ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de5bebd7613411cb782d31ed1884da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:03 user sudo[84196]: pam_unix(sudo:session): session closed for user root
Nov 19 14:48:03 user nova-compute[74934]: INFO oslo.privsep.daemon [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Spawned new privsep daemon via rootwrap
Nov 19 14:48:03 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 19 14:48:03 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 19 14:48:03 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 19 14:48:03 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84199
Nov 19 14:48:03 user nova-compute[74934]: WARNING oslo_privsep.priv_context [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] privsep daemon already running
Nov 19 14:48:03 user nova-compute[74934]: WARNING oslo_privsep.priv_context [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] privsep daemon already running
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.policy [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08d75edb533b4dfca6e9785c439df050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5862e932d40a68f17b4e8bb77ef77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Successfully created port: 2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Creating image(s)
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "/opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.161s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.155s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Successfully created port: bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk 1073741824" returned: 0 in 0.046s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.188s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.156s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.217s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk 1073741824" returned: 0 in 0.096s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.441s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Cannot resize image /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Ensure instance console log exists: /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.205s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk 1073741824" returned: 0 in 0.071s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.749s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Cannot resize image /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Ensure instance console log exists: /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Cannot resize image /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Ensure instance console log exists: /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk 1073741824" returned: 0 in 0.142s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.165s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Cannot resize image /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Ensure instance console log exists: /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Successfully created port: b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Successfully created port: 38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Successfully updated port: bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-changed-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Refreshing instance network info cache due to event network-changed-bd3c8114-6b3f-4adf-820a-42f5197fc7b4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Successfully updated port: 2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Instance network_info: |[{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.neutron [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Refreshing network info cache for port bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Start _get_guest_xml network_info=[{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:07 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:07 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1252279141',display_name='tempest-ServerActionsTestOtherA-server-1252279141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1252279141',id=2,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-7yzfhnsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=76da41ee-9c9b-4086-863d-7e6d3f3789b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'pci_devices' on Instance uuid 76da41ee-9c9b-4086-863d-7e6d3f3789b4 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:07 user nova-compute[74934]:   <uuid>76da41ee-9c9b-4086-863d-7e6d3f3789b4</uuid>
Nov 19 14:48:07 user nova-compute[74934]:   <name>instance-00000002</name>
Nov 19 14:48:07 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:07 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:07 user nova-compute[74934]:   <metadata>
Nov 19 14:48:07 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:07 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:07 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherA-server-1252279141</nova:name>
Nov 19 14:48:07 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:07</nova:creationTime>
Nov 19 14:48:07 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:07 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:07 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:07 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:user uuid="77319d6b70b24f22b39342f6955a8fef">tempest-ServerActionsTestOtherA-463456576-project-member</nova:user>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:project uuid="bd2d42525428465c90522337ec5a4b82">tempest-ServerActionsTestOtherA-463456576</nova:project>
Nov 19 14:48:07 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:07 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:07 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:07 user nova-compute[74934]:         <nova:port uuid="bd3c8114-6b3f-4adf-820a-42f5197fc7b4">
Nov 19 14:48:07 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 19 14:48:07 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:07 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:07 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:07 user nova-compute[74934]:   </metadata>
Nov 19 14:48:07 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:07 user nova-compute[74934]:     <system>
Nov 19 14:48:07 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:07 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:07 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:07 user nova-compute[74934]:       <entry name="serial">76da41ee-9c9b-4086-863d-7e6d3f3789b4</entry>
Nov 19 14:48:07 user nova-compute[74934]:       <entry name="uuid">76da41ee-9c9b-4086-863d-7e6d3f3789b4</entry>
Nov 19 14:48:07 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:07 user nova-compute[74934]:     </system>
Nov 19 14:48:07 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:07 user nova-compute[74934]:   <os>
Nov 19 14:48:07 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:07 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:07 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:07 user nova-compute[74934]:   </os>
Nov 19 14:48:07 user nova-compute[74934]:   <features>
Nov 19 14:48:07 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:07 user nova-compute[74934]:     <apic/>
Nov 19 14:48:07 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:07 user nova-compute[74934]:   </features>
Nov 19 14:48:07 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:07 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:07 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:07 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:07 user nova-compute[74934]:   </clock>
Nov 19 14:48:07 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:07 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:07 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:07 user nova-compute[74934]:   </cpu>
Nov 19 14:48:07 user nova-compute[74934]:   <devices>
Nov 19 14:48:07 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:07 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:07 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk"/>
Nov 19 14:48:07 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:07 user nova-compute[74934]:     </disk>
Nov 19 14:48:07 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:07 user nova-compute[74934]:       <mac address="fa:16:3e:e5:a9:4b"/>
Nov 19 14:48:07 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:07 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:07 user nova-compute[74934]:       <target dev="tapbd3c8114-6b"/>
Nov 19 14:48:07 user nova-compute[74934]:     </interface>
Nov 19 14:48:07 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:07 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/console.log" append="off"/>
Nov 19 14:48:07 user nova-compute[74934]:     </serial>
Nov 19 14:48:07 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:07 user nova-compute[74934]:     <video>
Nov 19 14:48:07 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:07 user nova-compute[74934]:     </video>
Nov 19 14:48:07 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:07 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:07 user nova-compute[74934]:     </rng>
Nov 19 14:48:07 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:07 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:07 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:07 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:07 user nova-compute[74934]:   </devices>
Nov 19 14:48:07 user nova-compute[74934]: </domain>
Nov 19 14:48:07 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1252279141',display_name='tempest-ServerActionsTestOtherA-server-1252279141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1252279141',id=2,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-7yzfhnsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=76da41ee-9c9b-4086-863d-7e6d3f3789b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG os_vif [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Created schema index Interface.name {{(pid=74934) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Created schema index Port.name {{(pid=74934) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Created schema index Bridge.name {{(pid=74934) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [POLLOUT] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.compute.manager [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-changed-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.compute.manager [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Refreshing instance network info cache due to event network-changed-2bfefc92-c855-4bd2-bf90-d7e3f7847926. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] Acquiring lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95161eb6-2b18-5145-905c-0727122ee9aa', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:07 user nova-compute[74934]: INFO oslo.privsep.daemon [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpsc2ykv4b/privsep.sock']
Nov 19 14:48:07 user sudo[84317]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpsc2ykv4b/privsep.sock
Nov 19 14:48:07 user sudo[84317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Successfully updated port: b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-changed-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Refreshing instance network info cache due to event network-changed-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] Acquiring lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.network.neutron [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updated VIF entry in instance network info cache for port bd3c8114-6b3f-4adf-820a-42f5197fc7b4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG nova.network.neutron [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-791bc8e5-7d68-4b9a-83c3-32f490feda48 req-46ba89b3-b61d-4710-9266-b673da93425b service nova] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:08 user sudo[84317]: pam_unix(sudo:session): session closed for user root
Nov 19 14:48:08 user nova-compute[74934]: INFO oslo.privsep.daemon [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Spawned new privsep daemon via rootwrap
Nov 19 14:48:08 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 19 14:48:08 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 19 14:48:08 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 19 14:48:08 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84320
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Instance network_info: |[{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] Acquired lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Refreshing network info cache for port b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Start _get_guest_xml network_info=[{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389079525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389079525',id=4,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-e09kr0tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:03Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=c493f2fb-19fd-4fee-a280-9b0df1a8362c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'pci_devices' on Instance uuid c493f2fb-19fd-4fee-a280-9b0df1a8362c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:09 user nova-compute[74934]:   <uuid>c493f2fb-19fd-4fee-a280-9b0df1a8362c</uuid>
Nov 19 14:48:09 user nova-compute[74934]:   <name>instance-00000004</name>
Nov 19 14:48:09 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:09 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:09 user nova-compute[74934]:   <metadata>
Nov 19 14:48:09 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:09 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1389079525</nova:name>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:09</nova:creationTime>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:09 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:09 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:user uuid="08d75edb533b4dfca6e9785c439df050">tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member</nova:user>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:project uuid="0da5862e932d40a68f17b4e8bb77ef77">tempest-ServerBootFromVolumeStableRescueTest-1047020547</nova:project>
Nov 19 14:48:09 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:port uuid="b81c9504-0fe8-49fd-964a-dc2dcb3e9afe">
Nov 19 14:48:09 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 19 14:48:09 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:09 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:09 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:09 user nova-compute[74934]:   </metadata>
Nov 19 14:48:09 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:09 user nova-compute[74934]:     <system>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="serial">c493f2fb-19fd-4fee-a280-9b0df1a8362c</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="uuid">c493f2fb-19fd-4fee-a280-9b0df1a8362c</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:09 user nova-compute[74934]:     </system>
Nov 19 14:48:09 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:09 user nova-compute[74934]:   <os>
Nov 19 14:48:09 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:09 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:09 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:09 user nova-compute[74934]:   </os>
Nov 19 14:48:09 user nova-compute[74934]:   <features>
Nov 19 14:48:09 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:09 user nova-compute[74934]:     <apic/>
Nov 19 14:48:09 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:09 user nova-compute[74934]:   </features>
Nov 19 14:48:09 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:09 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:09 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:09 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:09 user nova-compute[74934]:   </clock>
Nov 19 14:48:09 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:09 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:09 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:09 user nova-compute[74934]:   </cpu>
Nov 19 14:48:09 user nova-compute[74934]:   <devices>
Nov 19 14:48:09 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:09 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:09 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk"/>
Nov 19 14:48:09 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:09 user nova-compute[74934]:     </disk>
Nov 19 14:48:09 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:09 user nova-compute[74934]:       <mac address="fa:16:3e:ac:24:5f"/>
Nov 19 14:48:09 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:09 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:09 user nova-compute[74934]:       <target dev="tapb81c9504-0f"/>
Nov 19 14:48:09 user nova-compute[74934]:     </interface>
Nov 19 14:48:09 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:09 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/console.log" append="off"/>
Nov 19 14:48:09 user nova-compute[74934]:     </serial>
Nov 19 14:48:09 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:09 user nova-compute[74934]:     <video>
Nov 19 14:48:09 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:09 user nova-compute[74934]:     </video>
Nov 19 14:48:09 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:09 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:09 user nova-compute[74934]:     </rng>
Nov 19 14:48:09 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:09 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:09 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:09 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:09 user nova-compute[74934]:   </devices>
Nov 19 14:48:09 user nova-compute[74934]: </domain>
Nov 19 14:48:09 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389079525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389079525',id=4,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-e09kr0tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:03Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=c493f2fb-19fd-4fee-a280-9b0df1a8362c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG os_vif [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '280ff762-4617-5292-9da1-318d092f66c5', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:09 user nova-compute[74934]: INFO nova.compute.claims [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Claim successful on node user
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance network_info: |[{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] Acquired lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Refreshing network info cache for port 2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Start _get_guest_xml network_info=[{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-359330948',display_name='tempest-ServerRescueNegativeTestJSON-server-359330948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-359330948',id=1,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-3jgjyib6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:01Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=ede07940-0d9c-41ce-8d54-8b1d042f4da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'pci_devices' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:09 user nova-compute[74934]:   <uuid>ede07940-0d9c-41ce-8d54-8b1d042f4da2</uuid>
Nov 19 14:48:09 user nova-compute[74934]:   <name>instance-00000001</name>
Nov 19 14:48:09 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:09 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:09 user nova-compute[74934]:   <metadata>
Nov 19 14:48:09 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:09 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-359330948</nova:name>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:09</nova:creationTime>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:09 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:09 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:user uuid="cdbd678512a7438bac9bc337a0d94ecf">tempest-ServerRescueNegativeTestJSON-1330458851-project-member</nova:user>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:project uuid="0de5bebd7613411cb782d31ed1884da8">tempest-ServerRescueNegativeTestJSON-1330458851</nova:project>
Nov 19 14:48:09 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:09 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:09 user nova-compute[74934]:         <nova:port uuid="2bfefc92-c855-4bd2-bf90-d7e3f7847926">
Nov 19 14:48:09 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:48:09 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:09 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:09 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:09 user nova-compute[74934]:   </metadata>
Nov 19 14:48:09 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:09 user nova-compute[74934]:     <system>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="serial">ede07940-0d9c-41ce-8d54-8b1d042f4da2</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="uuid">ede07940-0d9c-41ce-8d54-8b1d042f4da2</entry>
Nov 19 14:48:09 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:09 user nova-compute[74934]:     </system>
Nov 19 14:48:09 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:09 user nova-compute[74934]:   <os>
Nov 19 14:48:09 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:09 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:09 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:09 user nova-compute[74934]:   </os>
Nov 19 14:48:09 user nova-compute[74934]:   <features>
Nov 19 14:48:09 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:09 user nova-compute[74934]:     <apic/>
Nov 19 14:48:09 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:09 user nova-compute[74934]:   </features>
Nov 19 14:48:09 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:09 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:09 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:09 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:09 user nova-compute[74934]:   </clock>
Nov 19 14:48:09 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:09 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:09 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:09 user nova-compute[74934]:   </cpu>
Nov 19 14:48:09 user nova-compute[74934]:   <devices>
Nov 19 14:48:09 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:09 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:09 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk"/>
Nov 19 14:48:09 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:09 user nova-compute[74934]:     </disk>
Nov 19 14:48:09 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:09 user nova-compute[74934]:       <mac address="fa:16:3e:61:d9:8c"/>
Nov 19 14:48:09 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:09 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:09 user nova-compute[74934]:       <target dev="tap2bfefc92-c8"/>
Nov 19 14:48:09 user nova-compute[74934]:     </interface>
Nov 19 14:48:09 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:09 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/console.log" append="off"/>
Nov 19 14:48:09 user nova-compute[74934]:     </serial>
Nov 19 14:48:09 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:09 user nova-compute[74934]:     <video>
Nov 19 14:48:09 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:09 user nova-compute[74934]:     </video>
Nov 19 14:48:09 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:09 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:09 user nova-compute[74934]:     </rng>
Nov 19 14:48:09 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:09 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:09 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:09 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:09 user nova-compute[74934]:   </devices>
Nov 19 14:48:09 user nova-compute[74934]: </domain>
Nov 19 14:48:09 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-359330948',display_name='tempest-ServerRescueNegativeTestJSON-server-359330948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-359330948',id=1,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-3jgjyib6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:01Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=ede07940-0d9c-41ce-8d54-8b1d042f4da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG os_vif [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2a9ec99-70ec-540b-a7f9-6c34d907781a', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd3c8114-6b, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd3c8114-6b, col_values=(('qos', UUID('fad69274-8b30-4943-9cad-f6a49462249c')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd3c8114-6b, col_values=(('external_ids', {'iface-id': 'bd3c8114-6b3f-4adf-820a-42f5197fc7b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:a9:4b', 'vm-uuid': '76da41ee-9c9b-4086-863d-7e6d3f3789b4'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: INFO os_vif [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b')
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb81c9504-0f, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb81c9504-0f, col_values=(('qos', UUID('561a872d-558d-4094-94f0-88bbc60f2b53')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb81c9504-0f, col_values=(('external_ids', {'iface-id': 'b81c9504-0fe8-49fd-964a-dc2dcb3e9afe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:24:5f', 'vm-uuid': 'c493f2fb-19fd-4fee-a280-9b0df1a8362c'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: INFO os_vif [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f')
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bfefc92-c8, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2bfefc92-c8, col_values=(('qos', UUID('a5bd454d-55d5-4e1d-8120-378929686617')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2bfefc92-c8, col_values=(('external_ids', {'iface-id': '2bfefc92-c855-4bd2-bf90-d7e3f7847926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:d9:8c', 'vm-uuid': 'ede07940-0d9c-41ce-8d54-8b1d042f4da2'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:09 user nova-compute[74934]: INFO os_vif [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8')
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No VIF found with MAC fa:16:3e:e5:a9:4b, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No VIF found with MAC fa:16:3e:ac:24:5f, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:61:d9:8c, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Successfully updated port: 38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.687s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-changed-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Refreshing instance network info cache due to event network-changed-38fdb168-5074-4b4f-9495-8986af433ea9. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] Acquiring lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Creating image(s)
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.policy [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef44dc0981394f5fb42de977994f483d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1735667909d4b3e94e6be7ba9a5ec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updated VIF entry in instance network info cache for port b81c9504-0fe8-49fd-964a-dc2dcb3e9afe. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e4f84d50-bf5a-4cc6-ba4d-8829b83167eb req-e92f51cc-7ee4-4d52-ade0-7393379d1612 service nova] Releasing lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk 1073741824" returned: 0 in 0.044s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updated VIF entry in instance network info cache for port 2bfefc92-c855-4bd2-bf90-d7e3f7847926. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f10d1241-9167-4320-b0e8-a7462b2c02ec req-9ec049ae-8d71-450d-9d26-d624fcb8d3b8 service nova] Releasing lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Cannot resize image /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Ensure instance console log exists: /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance network_info: |[{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] Acquired lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Refreshing network info cache for port 38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Start _get_guest_xml network_info=[{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:11 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:11 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998578892',display_name='tempest-ServerRescueNegativeTestJSON-server-998578892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998578892',id=3,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-kp4hnesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:03Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=73f74149-9044-4fd3-b73a-5082a7b0fd86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'pci_devices' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:11 user nova-compute[74934]:   <uuid>73f74149-9044-4fd3-b73a-5082a7b0fd86</uuid>
Nov 19 14:48:11 user nova-compute[74934]:   <name>instance-00000003</name>
Nov 19 14:48:11 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:11 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:11 user nova-compute[74934]:   <metadata>
Nov 19 14:48:11 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:11 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:11 user nova-compute[74934]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-998578892</nova:name>
Nov 19 14:48:11 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:11</nova:creationTime>
Nov 19 14:48:11 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:11 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:11 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:11 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:user uuid="cdbd678512a7438bac9bc337a0d94ecf">tempest-ServerRescueNegativeTestJSON-1330458851-project-member</nova:user>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:project uuid="0de5bebd7613411cb782d31ed1884da8">tempest-ServerRescueNegativeTestJSON-1330458851</nova:project>
Nov 19 14:48:11 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:11 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:11 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:11 user nova-compute[74934]:         <nova:port uuid="38fdb168-5074-4b4f-9495-8986af433ea9">
Nov 19 14:48:11 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 19 14:48:11 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:11 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:11 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:11 user nova-compute[74934]:   </metadata>
Nov 19 14:48:11 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:11 user nova-compute[74934]:     <system>
Nov 19 14:48:11 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:11 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:11 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:11 user nova-compute[74934]:       <entry name="serial">73f74149-9044-4fd3-b73a-5082a7b0fd86</entry>
Nov 19 14:48:11 user nova-compute[74934]:       <entry name="uuid">73f74149-9044-4fd3-b73a-5082a7b0fd86</entry>
Nov 19 14:48:11 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:11 user nova-compute[74934]:     </system>
Nov 19 14:48:11 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:11 user nova-compute[74934]:   <os>
Nov 19 14:48:11 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:11 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:11 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:11 user nova-compute[74934]:   </os>
Nov 19 14:48:11 user nova-compute[74934]:   <features>
Nov 19 14:48:11 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:11 user nova-compute[74934]:     <apic/>
Nov 19 14:48:11 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:11 user nova-compute[74934]:   </features>
Nov 19 14:48:11 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:11 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:11 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:11 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:11 user nova-compute[74934]:   </clock>
Nov 19 14:48:11 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:11 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:11 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:11 user nova-compute[74934]:   </cpu>
Nov 19 14:48:11 user nova-compute[74934]:   <devices>
Nov 19 14:48:11 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:11 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:11 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk"/>
Nov 19 14:48:11 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:11 user nova-compute[74934]:     </disk>
Nov 19 14:48:11 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:11 user nova-compute[74934]:       <mac address="fa:16:3e:70:f9:87"/>
Nov 19 14:48:11 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:11 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:11 user nova-compute[74934]:       <target dev="tap38fdb168-50"/>
Nov 19 14:48:11 user nova-compute[74934]:     </interface>
Nov 19 14:48:11 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:11 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/console.log" append="off"/>
Nov 19 14:48:11 user nova-compute[74934]:     </serial>
Nov 19 14:48:11 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:11 user nova-compute[74934]:     <video>
Nov 19 14:48:11 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:11 user nova-compute[74934]:     </video>
Nov 19 14:48:11 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:11 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:11 user nova-compute[74934]:     </rng>
Nov 19 14:48:11 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:11 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:11 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:11 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:11 user nova-compute[74934]:   </devices>
Nov 19 14:48:11 user nova-compute[74934]: </domain>
Nov 19 14:48:11 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998578892',display_name='tempest-ServerRescueNegativeTestJSON-server-998578892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998578892',id=3,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-kp4hnesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:03Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=73f74149-9044-4fd3-b73a-5082a7b0fd86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG os_vif [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1042373d-16b4-539f-a28e-be0e064cd1da', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38fdb168-50, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38fdb168-50, col_values=(('qos', UUID('67e83864-3839-47a7-b30d-1c08b5edc959')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38fdb168-50, col_values=(('external_ids', {'iface-id': '38fdb168-5074-4b4f-9495-8986af433ea9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:f9:87', 'vm-uuid': '73f74149-9044-4fd3-b73a-5082a7b0fd86'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:11 user nova-compute[74934]: INFO os_vif [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50')
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:70:f9:87, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Successfully created port: 0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updated VIF entry in instance network info cache for port 38fdb168-5074-4b4f-9495-8986af433ea9. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-81c94959-9ea3-4a7b-851d-447046d46452 req-79e156bb-0994-4c20-85e8-068c673e3aac service nova] Releasing lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Successfully updated port: 0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing instance network info cache due to event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance network_info: |[{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Start _get_guest_xml network_info=[{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:14 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:14 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825075697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825075697',id=5,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Y3h6aLjtCzoN+E+lUu1qIcE4QgeNEU2ikSyYhYWuvHg1BlmCQoBaFq86cdChZJUHwzciS4tr2s3Iu1W4lv2rIx8WLnP+FzMdefFfivNjQZMFhpRRsM0GJW1zVwz3eqg==',key_name='tempest-keypair-1600849378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-qq0f56qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=4eb838ad-d995-407b-ab5a-b8dc8df9a60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:14 user nova-compute[74934]:   <uuid>4eb838ad-d995-407b-ab5a-b8dc8df9a60e</uuid>
Nov 19 14:48:14 user nova-compute[74934]:   <name>instance-00000005</name>
Nov 19 14:48:14 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:14 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:14 user nova-compute[74934]:   <metadata>
Nov 19 14:48:14 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:14 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:14 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-825075697</nova:name>
Nov 19 14:48:14 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:14</nova:creationTime>
Nov 19 14:48:14 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:14 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:14 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:14 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:user uuid="ef44dc0981394f5fb42de977994f483d">tempest-AttachVolumeShelveTestJSON-884997441-project-member</nova:user>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:project uuid="f1735667909d4b3e94e6be7ba9a5ec7f">tempest-AttachVolumeShelveTestJSON-884997441</nova:project>
Nov 19 14:48:14 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:14 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:14 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:14 user nova-compute[74934]:         <nova:port uuid="0cd621cf-48bb-4332-9f77-72fd63bf014b">
Nov 19 14:48:14 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 19 14:48:14 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:14 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:14 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:14 user nova-compute[74934]:   </metadata>
Nov 19 14:48:14 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:14 user nova-compute[74934]:     <system>
Nov 19 14:48:14 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:14 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:14 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:14 user nova-compute[74934]:       <entry name="serial">4eb838ad-d995-407b-ab5a-b8dc8df9a60e</entry>
Nov 19 14:48:14 user nova-compute[74934]:       <entry name="uuid">4eb838ad-d995-407b-ab5a-b8dc8df9a60e</entry>
Nov 19 14:48:14 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:14 user nova-compute[74934]:     </system>
Nov 19 14:48:14 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:14 user nova-compute[74934]:   <os>
Nov 19 14:48:14 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:14 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:14 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:14 user nova-compute[74934]:   </os>
Nov 19 14:48:14 user nova-compute[74934]:   <features>
Nov 19 14:48:14 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:14 user nova-compute[74934]:     <apic/>
Nov 19 14:48:14 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:14 user nova-compute[74934]:   </features>
Nov 19 14:48:14 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:14 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:14 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:14 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:14 user nova-compute[74934]:   </clock>
Nov 19 14:48:14 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:14 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:14 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:14 user nova-compute[74934]:   </cpu>
Nov 19 14:48:14 user nova-compute[74934]:   <devices>
Nov 19 14:48:14 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:14 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:14 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk"/>
Nov 19 14:48:14 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:14 user nova-compute[74934]:     </disk>
Nov 19 14:48:14 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:14 user nova-compute[74934]:       <mac address="fa:16:3e:a8:0b:6b"/>
Nov 19 14:48:14 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:14 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:14 user nova-compute[74934]:       <target dev="tap0cd621cf-48"/>
Nov 19 14:48:14 user nova-compute[74934]:     </interface>
Nov 19 14:48:14 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:14 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/console.log" append="off"/>
Nov 19 14:48:14 user nova-compute[74934]:     </serial>
Nov 19 14:48:14 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:14 user nova-compute[74934]:     <video>
Nov 19 14:48:14 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:14 user nova-compute[74934]:     </video>
Nov 19 14:48:14 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:14 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:14 user nova-compute[74934]:     </rng>
Nov 19 14:48:14 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:14 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:14 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:14 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:14 user nova-compute[74934]:   </devices>
Nov 19 14:48:14 user nova-compute[74934]: </domain>
Nov 19 14:48:14 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825075697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825075697',id=5,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Y3h6aLjtCzoN+E+lUu1qIcE4QgeNEU2ikSyYhYWuvHg1BlmCQoBaFq86cdChZJUHwzciS4tr2s3Iu1W4lv2rIx8WLnP+FzMdefFfivNjQZMFhpRRsM0GJW1zVwz3eqg==',key_name='tempest-keypair-1600849378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-qq0f56qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=4eb838ad-d995-407b-ab5a-b8dc8df9a60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG os_vif [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7942f3af-ba9b-5447-a9a6-93da35894325', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cd621cf-48, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cd621cf-48, col_values=(('qos', UUID('224d9610-c11f-4892-bf9c-7f14e6748223')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cd621cf-48, col_values=(('external_ids', {'iface-id': '0cd621cf-48bb-4332-9f77-72fd63bf014b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:0b:6b', 'vm-uuid': '4eb838ad-d995-407b-ab5a-b8dc8df9a60e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:14 user nova-compute[74934]: INFO os_vif [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48')
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No VIF found with MAC fa:16:3e:a8:0b:6b, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updated VIF entry in instance network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-22985265-f479-4545-b6b4-beba278242f4 req-a637dd82-1146-49c1-b539-95ae61782bfc service nova] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance spawned successfully.
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: INFO nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Took 17.96 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:18 user nova-compute[74934]: INFO nova.compute.manager [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Took 18.92 seconds to build instance.
Nov 19 14:48:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f37d29c5-3b5d-4c14-9679-8577cd74cd8b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.422s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Instance spawned successfully.
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Took 17.01 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance spawned successfully.
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.compute.manager [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Took 18.02 seconds to build instance.
Nov 19 14:48:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a15862b-48f3-4e62-be44-50175368ffbb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.222s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Took 16.47 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.compute.manager [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Took 17.49 seconds to build instance.
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Instance spawned successfully.
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57cb79e-1708-46cf-b185-5bbda3f7e5de tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.764s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:19 user nova-compute[74934]: INFO nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Took 16.37 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:20 user nova-compute[74934]: INFO nova.compute.manager [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Took 17.78 seconds to build instance.
Nov 19 14:48:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dddf3e86-b648-4743-9b2d-f98486683911 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.904s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance spawned successfully.
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:20 user nova-compute[74934]: INFO nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Took 10.58 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:20 user nova-compute[74934]: INFO nova.compute.manager [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Took 11.71 seconds to build instance.
Nov 19 14:48:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ada8c414-0850-47bb-a010-8f42ca231157 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.882s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:25 user nova-compute[74934]: INFO nova.compute.claims [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Claim successful on node user
Nov 19 14:48:25 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:25 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.policy [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '563b7f767dd949cf8813529257cd7001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3605109f7c2469095a20fe29e980ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Creating image(s)
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "/opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "/opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.303s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:27 user nova-compute[74934]: INFO nova.compute.claims [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Claim successful on node user
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.376s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk 1073741824" returned: 0 in 0.094s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.483s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.303s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Cannot resize image /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Ensure instance console log exists: /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.827s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:27 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Successfully created port: 4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.policy [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60694a255c3d415ab100a0d7d8fefb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3964523815cf488dabb1ecae9c4b70a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Creating image(s)
Nov 19 14:48:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "/opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "/opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "56e3598c05011ec627daf4f8ff945cdc6690ed8a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "56e3598c05011ec627daf4f8ff945cdc6690ed8a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.part --force-share --output=json" returned: 0 in 0.259s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG nova.virt.images [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] a99df65f-f80d-4c57-81f8-48db9486e1aa was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.part /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Successfully created port: e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-b1ddd8b1-bc92-44c1-936e-c4c3b540e928 req-caf864d2-3bef-43bc-b9b7-58027291a6ed service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b1ddd8b1-bc92-44c1-936e-c4c3b540e928 req-caf864d2-3bef-43bc-b9b7-58027291a6ed service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b1ddd8b1-bc92-44c1-936e-c4c3b540e928 req-caf864d2-3bef-43bc-b9b7-58027291a6ed service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b1ddd8b1-bc92-44c1-936e-c4c3b540e928 req-caf864d2-3bef-43bc-b9b7-58027291a6ed service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-b1ddd8b1-bc92-44c1-936e-c4c3b540e928 req-caf864d2-3bef-43bc-b9b7-58027291a6ed service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:29 user nova-compute[74934]: WARNING nova.compute.manager [req-b1ddd8b1-bc92-44c1-936e-c4c3b540e928 req-caf864d2-3bef-43bc-b9b7-58027291a6ed service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state active and task_state None.
Nov 19 14:48:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.part /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.converted" returned: 0 in 0.344s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "56e3598c05011ec627daf4f8ff945cdc6690ed8a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.647s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a --force-share --output=json" returned: 0 in 0.214s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "56e3598c05011ec627daf4f8ff945cdc6690ed8a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "56e3598c05011ec627daf4f8ff945cdc6690ed8a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a --force-share --output=json" returned: 0 in 0.246s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a,backing_fmt=raw /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a,backing_fmt=raw /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk 1073741824" returned: 0 in 0.057s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "56e3598c05011ec627daf4f8ff945cdc6690ed8a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-85df05e1-b001-4e32-b61d-ab1870657d4d req-ea4f5566-f4c6-4a62-b983-be9db750295e service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85df05e1-b001-4e32-b61d-ab1870657d4d req-ea4f5566-f4c6-4a62-b983-be9db750295e service nova] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85df05e1-b001-4e32-b61d-ab1870657d4d req-ea4f5566-f4c6-4a62-b983-be9db750295e service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85df05e1-b001-4e32-b61d-ab1870657d4d req-ea4f5566-f4c6-4a62-b983-be9db750295e service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-85df05e1-b001-4e32-b61d-ab1870657d4d req-ea4f5566-f4c6-4a62-b983-be9db750295e service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] No waiting events found dispatching network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:30 user nova-compute[74934]: WARNING nova.compute.manager [req-85df05e1-b001-4e32-b61d-ab1870657d4d req-ea4f5566-f4c6-4a62-b983-be9db750295e service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received unexpected event network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe for instance with vm_state active and task_state None.
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Successfully updated port: 4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquired lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a --force-share --output=json" returned: 0 in 0.287s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Successfully updated port: e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquired lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Cannot resize image /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Ensure instance console log exists: /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updating instance_info_cache with network_info: [{"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Releasing lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Instance network_info: |[{"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Start _get_guest_xml network_info=[{"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:48:16Z,direct_url=<?>,disk_format='qcow2',id=a99df65f-f80d-4c57-81f8-48db9486e1aa,min_disk=0,min_ram=0,name='',owner='16d527d1f283451eb0d8185dc5af0d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:48:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/sda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'image_id': 'a99df65f-f80d-4c57-81f8-48db9486e1aa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:48:16Z,direct_url=<?>,disk_format='qcow2',id=a99df65f-f80d-4c57-81f8-48db9486e1aa,min_disk=0,min_ram=0,name='',owner='16d527d1f283451eb0d8185dc5af0d71',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:48:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-619053951',display_name='tempest-AttachSCSIVolumeTestJSON-server-619053951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-619053951',id=7,image_ref='a99df65f-f80d-4c57-81f8-48db9486e1aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtStTblgPv+8QGVCuHbBc1FEc9i977mmGJGiS3w+wkF8VU/mzTx8CL/5l1uGaL7JKbiILkB8HXwApsLRUv41IaJ/3Y8Sx+F/4mhNuxBmQeaGuOULtz1aKdvidcARYnznQ==',key_name='tempest-keypair-875654113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3964523815cf488dabb1ecae9c4b70a7',ramdisk_id='',reservation_id='r-2bg09ks0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99df65f-f80d-4c57-81f8-48db9486e1aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-320927024',owner_user_name='tempest-AttachSCSIVolumeTestJSON-320927024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60694a255c3d415ab100a0d7d8fefb05',uuid=2e319dfa-bb7c-461a-a408-c8f7edf6c221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Converting VIF {"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e319dfa-bb7c-461a-a408-c8f7edf6c221 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:31 user nova-compute[74934]:   <uuid>2e319dfa-bb7c-461a-a408-c8f7edf6c221</uuid>
Nov 19 14:48:31 user nova-compute[74934]:   <name>instance-00000007</name>
Nov 19 14:48:31 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:31 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:31 user nova-compute[74934]:   <metadata>
Nov 19 14:48:31 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:31 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:31 user nova-compute[74934]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-619053951</nova:name>
Nov 19 14:48:31 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:31</nova:creationTime>
Nov 19 14:48:31 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:31 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:31 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:31 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:user uuid="60694a255c3d415ab100a0d7d8fefb05">tempest-AttachSCSIVolumeTestJSON-320927024-project-member</nova:user>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:project uuid="3964523815cf488dabb1ecae9c4b70a7">tempest-AttachSCSIVolumeTestJSON-320927024</nova:project>
Nov 19 14:48:31 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:31 user nova-compute[74934]:       <nova:root type="image" uuid="a99df65f-f80d-4c57-81f8-48db9486e1aa"/>
Nov 19 14:48:31 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:31 user nova-compute[74934]:         <nova:port uuid="e29f0db5-7542-47c0-a806-709a6982344e">
Nov 19 14:48:31 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 19 14:48:31 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:31 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:31 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:31 user nova-compute[74934]:   </metadata>
Nov 19 14:48:31 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:31 user nova-compute[74934]:     <system>
Nov 19 14:48:31 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:31 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:31 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:31 user nova-compute[74934]:       <entry name="serial">2e319dfa-bb7c-461a-a408-c8f7edf6c221</entry>
Nov 19 14:48:31 user nova-compute[74934]:       <entry name="uuid">2e319dfa-bb7c-461a-a408-c8f7edf6c221</entry>
Nov 19 14:48:31 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:31 user nova-compute[74934]:     </system>
Nov 19 14:48:31 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:31 user nova-compute[74934]:   <os>
Nov 19 14:48:31 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:31 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:31 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:31 user nova-compute[74934]:   </os>
Nov 19 14:48:31 user nova-compute[74934]:   <features>
Nov 19 14:48:31 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:31 user nova-compute[74934]:     <apic/>
Nov 19 14:48:31 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:31 user nova-compute[74934]:   </features>
Nov 19 14:48:31 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:31 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:31 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:31 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:31 user nova-compute[74934]:   </clock>
Nov 19 14:48:31 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:31 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:31 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:31 user nova-compute[74934]:   </cpu>
Nov 19 14:48:31 user nova-compute[74934]:   <devices>
Nov 19 14:48:31 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:31 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:31 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk"/>
Nov 19 14:48:31 user nova-compute[74934]:       <target dev="sda" bus="scsi"/>
Nov 19 14:48:31 user nova-compute[74934]:       <address type="drive" controller="0" unit="0"/>
Nov 19 14:48:31 user nova-compute[74934]:     </disk>
Nov 19 14:48:31 user nova-compute[74934]:     <disk type="file" device="cdrom">
Nov 19 14:48:31 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none"/>
Nov 19 14:48:31 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.config"/>
Nov 19 14:48:31 user nova-compute[74934]:       <target dev="sdb" bus="scsi"/>
Nov 19 14:48:31 user nova-compute[74934]:       <address type="drive" controller="0" unit="1"/>
Nov 19 14:48:31 user nova-compute[74934]:     </disk>
Nov 19 14:48:31 user nova-compute[74934]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 19 14:48:31 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:31 user nova-compute[74934]:       <mac address="fa:16:3e:8f:e0:bb"/>
Nov 19 14:48:31 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:31 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:31 user nova-compute[74934]:       <target dev="tape29f0db5-75"/>
Nov 19 14:48:31 user nova-compute[74934]:     </interface>
Nov 19 14:48:31 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:31 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/console.log" append="off"/>
Nov 19 14:48:31 user nova-compute[74934]:     </serial>
Nov 19 14:48:31 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:31 user nova-compute[74934]:     <video>
Nov 19 14:48:31 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:31 user nova-compute[74934]:     </video>
Nov 19 14:48:31 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:31 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:31 user nova-compute[74934]:     </rng>
Nov 19 14:48:31 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:31 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:31 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:31 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:31 user nova-compute[74934]:   </devices>
Nov 19 14:48:31 user nova-compute[74934]: </domain>
Nov 19 14:48:31 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-619053951',display_name='tempest-AttachSCSIVolumeTestJSON-server-619053951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-619053951',id=7,image_ref='a99df65f-f80d-4c57-81f8-48db9486e1aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtStTblgPv+8QGVCuHbBc1FEc9i977mmGJGiS3w+wkF8VU/mzTx8CL/5l1uGaL7JKbiILkB8HXwApsLRUv41IaJ/3Y8Sx+F/4mhNuxBmQeaGuOULtz1aKdvidcARYnznQ==',key_name='tempest-keypair-875654113',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3964523815cf488dabb1ecae9c4b70a7',ramdisk_id='',reservation_id='r-2bg09ks0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99df65f-f80d-4c57-81f8-48db9486e1aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-320927024',owner_user_name='tempest-AttachSCSIVolumeTestJSON-320927024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60694a255c3d415ab100a0d7d8fefb05',uuid=2e319dfa-bb7c-461a-a408-c8f7edf6c221,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Converting VIF {"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG os_vif [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59960746-9431-50dd-bfff-2fce1b2e2e7b', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape29f0db5-75, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape29f0db5-75, col_values=(('qos', UUID('96ae72f0-6d18-4a13-8f6f-a58645b7e32c')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape29f0db5-75, col_values=(('external_ids', {'iface-id': 'e29f0db5-7542-47c0-a806-709a6982344e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:e0:bb', 'vm-uuid': '2e319dfa-bb7c-461a-a408-c8f7edf6c221'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:31 user nova-compute[74934]: INFO os_vif [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75')
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No BDM found with device name sda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No VIF found with MAC fa:16:3e:8f:e0:bb, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Using config drive
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:32 user nova-compute[74934]: WARNING nova.compute.manager [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state active and task_state None.
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-changed-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Refreshing instance network info cache due to event network-changed-4cc72428-c39e-4bb5-8c34-f64c3b294e95. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] Acquiring lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:32 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Creating config drive at /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.config
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnzmaxosa {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnzmaxosa" returned: 0 in 0.057s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updating instance_info_cache with network_info: [{"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Releasing lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Instance network_info: |[{"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] Acquired lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Refreshing network info cache for port 4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Start _get_guest_xml network_info=[{"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-847658597',display_name='tempest-VolumesAdminNegativeTest-server-847658597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-847658597',id=6,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCayk4vCNpwTRr7ESQxY9t6Hx/UmZH/ltfKGAAhenoOZsW/jsjkwMJkY9luULJrEtqscjRn43brE0Y235s5Hu63Ke3Q5TFGjzmOJ2U/I4Q0N1TlJbjS0yIlIYFrIxfDcg==',key_name='tempest-keypair-1441234184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3605109f7c2469095a20fe29e980ac3',ramdisk_id='',reservation_id='r-zj1vie55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-539978045',owner_user_name='tempest-VolumesAdminNegativeTest-539978045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='563b7f767dd949cf8813529257cd7001',uuid=8b33af6a-67df-485c-84d9-ce224f78e67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converting VIF {"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:32 user nova-compute[74934]:   <uuid>8b33af6a-67df-485c-84d9-ce224f78e67c</uuid>
Nov 19 14:48:32 user nova-compute[74934]:   <name>instance-00000006</name>
Nov 19 14:48:32 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:32 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:32 user nova-compute[74934]:   <metadata>
Nov 19 14:48:32 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:32 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:32 user nova-compute[74934]:       <nova:name>tempest-VolumesAdminNegativeTest-server-847658597</nova:name>
Nov 19 14:48:32 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:32</nova:creationTime>
Nov 19 14:48:32 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:32 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:32 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:32 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:user uuid="563b7f767dd949cf8813529257cd7001">tempest-VolumesAdminNegativeTest-539978045-project-member</nova:user>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:project uuid="a3605109f7c2469095a20fe29e980ac3">tempest-VolumesAdminNegativeTest-539978045</nova:project>
Nov 19 14:48:32 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:32 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:32 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:32 user nova-compute[74934]:         <nova:port uuid="4cc72428-c39e-4bb5-8c34-f64c3b294e95">
Nov 19 14:48:32 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 19 14:48:32 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:32 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:32 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:32 user nova-compute[74934]:   </metadata>
Nov 19 14:48:32 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:32 user nova-compute[74934]:     <system>
Nov 19 14:48:32 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:32 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:32 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:32 user nova-compute[74934]:       <entry name="serial">8b33af6a-67df-485c-84d9-ce224f78e67c</entry>
Nov 19 14:48:32 user nova-compute[74934]:       <entry name="uuid">8b33af6a-67df-485c-84d9-ce224f78e67c</entry>
Nov 19 14:48:32 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:32 user nova-compute[74934]:     </system>
Nov 19 14:48:32 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:32 user nova-compute[74934]:   <os>
Nov 19 14:48:32 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:32 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:32 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:32 user nova-compute[74934]:   </os>
Nov 19 14:48:32 user nova-compute[74934]:   <features>
Nov 19 14:48:32 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:32 user nova-compute[74934]:     <apic/>
Nov 19 14:48:32 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:32 user nova-compute[74934]:   </features>
Nov 19 14:48:32 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:32 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:32 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:32 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:32 user nova-compute[74934]:   </clock>
Nov 19 14:48:32 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:32 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:32 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:32 user nova-compute[74934]:   </cpu>
Nov 19 14:48:32 user nova-compute[74934]:   <devices>
Nov 19 14:48:32 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:32 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:32 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk"/>
Nov 19 14:48:32 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:32 user nova-compute[74934]:     </disk>
Nov 19 14:48:32 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:32 user nova-compute[74934]:       <mac address="fa:16:3e:97:c7:cb"/>
Nov 19 14:48:32 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:32 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:32 user nova-compute[74934]:       <target dev="tap4cc72428-c3"/>
Nov 19 14:48:32 user nova-compute[74934]:     </interface>
Nov 19 14:48:32 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:32 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/console.log" append="off"/>
Nov 19 14:48:32 user nova-compute[74934]:     </serial>
Nov 19 14:48:32 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:32 user nova-compute[74934]:     <video>
Nov 19 14:48:32 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:32 user nova-compute[74934]:     </video>
Nov 19 14:48:32 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:32 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:32 user nova-compute[74934]:     </rng>
Nov 19 14:48:32 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:32 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:32 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:32 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:32 user nova-compute[74934]:   </devices>
Nov 19 14:48:32 user nova-compute[74934]: </domain>
Nov 19 14:48:32 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-847658597',display_name='tempest-VolumesAdminNegativeTest-server-847658597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-847658597',id=6,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCayk4vCNpwTRr7ESQxY9t6Hx/UmZH/ltfKGAAhenoOZsW/jsjkwMJkY9luULJrEtqscjRn43brE0Y235s5Hu63Ke3Q5TFGjzmOJ2U/I4Q0N1TlJbjS0yIlIYFrIxfDcg==',key_name='tempest-keypair-1441234184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3605109f7c2469095a20fe29e980ac3',ramdisk_id='',reservation_id='r-zj1vie55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-539978045',owner_user_name='tempest-VolumesAdminNegativeTest-539978045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='563b7f767dd949cf8813529257cd7001',uuid=8b33af6a-67df-485c-84d9-ce224f78e67c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converting VIF {"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG os_vif [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46e79a55-dbf5-5071-88b7-75b9a3fe8176', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cc72428-c3, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cc72428-c3, col_values=(('qos', UUID('3c317a75-ce63-4f9f-9def-1696dd51c58d')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cc72428-c3, col_values=(('external_ids', {'iface-id': '4cc72428-c39e-4bb5-8c34-f64c3b294e95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:c7:cb', 'vm-uuid': '8b33af6a-67df-485c-84d9-ce224f78e67c'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:32 user nova-compute[74934]: INFO os_vif [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3')
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No VIF found with MAC fa:16:3e:97:c7:cb, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-changed-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Refreshing instance network info cache due to event network-changed-e29f0db5-7542-47c0-a806-709a6982344e. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] Acquiring lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] Acquired lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Refreshing network info cache for port e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG nova.network.neutron [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updated VIF entry in instance network info cache for port e29f0db5-7542-47c0-a806-709a6982344e. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG nova.network.neutron [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updating instance_info_cache with network_info: [{"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG nova.network.neutron [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updated VIF entry in instance network info cache for port 4cc72428-c39e-4bb5-8c34-f64c3b294e95. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG nova.network.neutron [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updating instance_info_cache with network_info: [{"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] Releasing lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] No waiting events found dispatching network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:33 user nova-compute[74934]: WARNING nova.compute.manager [req-834ceed2-bb8e-4348-801e-1295faf1c721 req-e19d935b-4d3b-45ec-b0f5-c0f01a70d99c service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received unexpected event network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe for instance with vm_state active and task_state None.
Nov 19 14:48:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62be72a7-e8bc-4a54-9877-69cf705a99c6 req-81b44633-a69a-439e-95af-033f75934e87 service nova] Releasing lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:34 user nova-compute[74934]: INFO nova.compute.claims [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Claim successful on node user
Nov 19 14:48:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.901s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Creating image(s)
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG nova.policy [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5575961a25d9487ab557835abe15c460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5463253de6814508960ba3cd7514bb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.223s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.207s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk 1073741824" returned: 0 in 0.066s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.310s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Cannot resize image /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Ensure instance console log exists: /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-9cdff535-f75e-4e64-8ebe-cbe1959a5c78 req-5d5bf9b9-5975-4075-99bc-20c319ee6a0e service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9cdff535-f75e-4e64-8ebe-cbe1959a5c78 req-5d5bf9b9-5975-4075-99bc-20c319ee6a0e service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9cdff535-f75e-4e64-8ebe-cbe1959a5c78 req-5d5bf9b9-5975-4075-99bc-20c319ee6a0e service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9cdff535-f75e-4e64-8ebe-cbe1959a5c78 req-5d5bf9b9-5975-4075-99bc-20c319ee6a0e service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-9cdff535-f75e-4e64-8ebe-cbe1959a5c78 req-5d5bf9b9-5975-4075-99bc-20c319ee6a0e service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:37 user nova-compute[74934]: WARNING nova.compute.manager [req-9cdff535-f75e-4e64-8ebe-cbe1959a5c78 req-5d5bf9b9-5975-4075-99bc-20c319ee6a0e service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state active and task_state None.
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Successfully created port: 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:37 user nova-compute[74934]: INFO nova.compute.claims [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Claim successful on node user
Nov 19 14:48:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:37 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Successfully updated port: 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquired lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-changed-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Refreshing instance network info cache due to event network-changed-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] Acquiring lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.policy [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e49caa51459e4cd7a48fec02749c59e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307424c45f2441cea52f6a6474184e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Creating image(s)
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "/opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "/opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "/opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Instance spawned successfully.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Instance spawned successfully.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Releasing lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Instance network_info: |[{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] Acquired lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Refreshing network info cache for port 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Start _get_guest_xml network_info=[{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:38 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:38 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.256s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Took 10.48 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Took 12.32 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'pci_devices' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:38 user nova-compute[74934]:   <uuid>b7614315-a839-4dbf-8137-9b4a096bea5b</uuid>
Nov 19 14:48:38 user nova-compute[74934]:   <name>instance-00000008</name>
Nov 19 14:48:38 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:38 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:38 user nova-compute[74934]:   <metadata>
Nov 19 14:48:38 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:38 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:38 user nova-compute[74934]:       <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:48:38 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:38</nova:creationTime>
Nov 19 14:48:38 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:38 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:38 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:38 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:48:38 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:38 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:38 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:38 user nova-compute[74934]:         <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:48:38 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:48:38 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:38 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:38 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:38 user nova-compute[74934]:   </metadata>
Nov 19 14:48:38 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:38 user nova-compute[74934]:     <system>
Nov 19 14:48:38 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:38 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:38 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:38 user nova-compute[74934]:       <entry name="serial">b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:48:38 user nova-compute[74934]:       <entry name="uuid">b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:48:38 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:38 user nova-compute[74934]:     </system>
Nov 19 14:48:38 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:38 user nova-compute[74934]:   <os>
Nov 19 14:48:38 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:38 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:38 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:38 user nova-compute[74934]:   </os>
Nov 19 14:48:38 user nova-compute[74934]:   <features>
Nov 19 14:48:38 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:38 user nova-compute[74934]:     <apic/>
Nov 19 14:48:38 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:38 user nova-compute[74934]:   </features>
Nov 19 14:48:38 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:38 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:38 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:38 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:38 user nova-compute[74934]:   </clock>
Nov 19 14:48:38 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:38 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:38 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:38 user nova-compute[74934]:   </cpu>
Nov 19 14:48:38 user nova-compute[74934]:   <devices>
Nov 19 14:48:38 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:38 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:38 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk"/>
Nov 19 14:48:38 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:38 user nova-compute[74934]:     </disk>
Nov 19 14:48:38 user nova-compute[74934]:     <disk type="file" device="cdrom">
Nov 19 14:48:38 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none"/>
Nov 19 14:48:38 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config"/>
Nov 19 14:48:38 user nova-compute[74934]:       <target dev="hda" bus="ide"/>
Nov 19 14:48:38 user nova-compute[74934]:     </disk>
Nov 19 14:48:38 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:38 user nova-compute[74934]:       <mac address="fa:16:3e:7d:a1:30"/>
Nov 19 14:48:38 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:38 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:38 user nova-compute[74934]:       <target dev="tap99f638f7-1e"/>
Nov 19 14:48:38 user nova-compute[74934]:     </interface>
Nov 19 14:48:38 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:38 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log" append="off"/>
Nov 19 14:48:38 user nova-compute[74934]:     </serial>
Nov 19 14:48:38 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:38 user nova-compute[74934]:     <video>
Nov 19 14:48:38 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:38 user nova-compute[74934]:     </video>
Nov 19 14:48:38 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:38 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:38 user nova-compute[74934]:     </rng>
Nov 19 14:48:38 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:38 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:38 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:38 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:38 user nova-compute[74934]:   </devices>
Nov 19 14:48:38 user nova-compute[74934]: </domain>
Nov 19 14:48:38 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG os_vif [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f88fbf5a-6e23-5bcb-babb-b51d5279727d', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99f638f7-1e, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99f638f7-1e, col_values=(('qos', UUID('0013eb87-ad68-4ce2-86eb-131b721493e0')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99f638f7-1e, col_values=(('external_ids', {'iface-id': '99f638f7-1e8c-4ae1-b4ed-c6a438e703f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:a1:30', 'vm-uuid': 'b7614315-a839-4dbf-8137-9b4a096bea5b'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.compute.manager [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Took 11.88 seconds to build instance.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:38 user nova-compute[74934]: INFO os_vif [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e')
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7df7c23-3342-4859-a286-ab40668fa7b1 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.069s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.257s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:38 user nova-compute[74934]: INFO nova.compute.manager [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Took 13.80 seconds to build instance.
Nov 19 14:48:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebe56a97-6b60-4945-a0f2-b1c1c2886102 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.182s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk 1073741824" returned: 0 in 0.063s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No BDM found with device name hda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No VIF found with MAC fa:16:3e:7d:a1:30, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Using config drive
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-f65d6f2a-9b27-49f1-b9ea-686f59021d1f req-d073756f-6578-45df-82c4-740b6cf93b95 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f65d6f2a-9b27-49f1-b9ea-686f59021d1f req-d073756f-6578-45df-82c4-740b6cf93b95 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f65d6f2a-9b27-49f1-b9ea-686f59021d1f req-d073756f-6578-45df-82c4-740b6cf93b95 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f65d6f2a-9b27-49f1-b9ea-686f59021d1f req-d073756f-6578-45df-82c4-740b6cf93b95 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-f65d6f2a-9b27-49f1-b9ea-686f59021d1f req-d073756f-6578-45df-82c4-740b6cf93b95 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:39 user nova-compute[74934]: WARNING nova.compute.manager [req-f65d6f2a-9b27-49f1-b9ea-686f59021d1f req-d073756f-6578-45df-82c4-740b6cf93b95 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state active and task_state None.
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Successfully created port: 717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.241s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Creating config drive at /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqfbwop59 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqfbwop59" returned: 0 in 0.064s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Cannot resize image /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Ensure instance console log exists: /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.network.neutron [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updated VIF entry in instance network info cache for port 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG nova.network.neutron [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-612bbd5e-31da-4de2-af64-404a3abbea7a req-4b5cc770-e9ce-4d20-bc4c-f61e54ca2774 service nova] Releasing lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Successfully updated port: 717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquired lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updating instance_info_cache with network_info: [{"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Releasing lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Instance network_info: |[{"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Start _get_guest_xml network_info=[{"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:40 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:40 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-821473053',display_name='tempest-TestVolumeSwap-server-821473053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-821473053',id=9,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWVmU5HP3zWRUozy3jQq9bASJyjx/3Oq2HlkLYwAfhZ+Tq3iQg5SIcsEHy59OGcoNIbM+EL0vjaCPjjYQPrUglDFqstjOyZwuSvbw1tJJziRuvOI0lMYu1z27PWXONnHA==',key_name='tempest-keypair-1796979662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='307424c45f2441cea52f6a6474184e9a',ramdisk_id='',reservation_id='r-cejmkbur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-521432732',owner_user_name='tempest-TestVolumeSwap-521432732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e49caa51459e4cd7a48fec02749c59e4',uuid=60dddb96-ee81-4cc8-8960-7e0189d4543b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Converting VIF {"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lazy-loading 'pci_devices' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:40 user nova-compute[74934]:   <uuid>60dddb96-ee81-4cc8-8960-7e0189d4543b</uuid>
Nov 19 14:48:40 user nova-compute[74934]:   <name>instance-00000009</name>
Nov 19 14:48:40 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:40 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:40 user nova-compute[74934]:   <metadata>
Nov 19 14:48:40 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:40 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:40 user nova-compute[74934]:       <nova:name>tempest-TestVolumeSwap-server-821473053</nova:name>
Nov 19 14:48:40 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:40</nova:creationTime>
Nov 19 14:48:40 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:40 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:40 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:40 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:user uuid="e49caa51459e4cd7a48fec02749c59e4">tempest-TestVolumeSwap-521432732-project-member</nova:user>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:project uuid="307424c45f2441cea52f6a6474184e9a">tempest-TestVolumeSwap-521432732</nova:project>
Nov 19 14:48:40 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:40 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:40 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:40 user nova-compute[74934]:         <nova:port uuid="717622fa-a1ff-4988-9e16-f399ba8f9020">
Nov 19 14:48:40 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 14:48:40 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:40 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:40 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:40 user nova-compute[74934]:   </metadata>
Nov 19 14:48:40 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:40 user nova-compute[74934]:     <system>
Nov 19 14:48:40 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:40 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:40 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:40 user nova-compute[74934]:       <entry name="serial">60dddb96-ee81-4cc8-8960-7e0189d4543b</entry>
Nov 19 14:48:40 user nova-compute[74934]:       <entry name="uuid">60dddb96-ee81-4cc8-8960-7e0189d4543b</entry>
Nov 19 14:48:40 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:40 user nova-compute[74934]:     </system>
Nov 19 14:48:40 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:40 user nova-compute[74934]:   <os>
Nov 19 14:48:40 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:40 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:40 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:40 user nova-compute[74934]:   </os>
Nov 19 14:48:40 user nova-compute[74934]:   <features>
Nov 19 14:48:40 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:40 user nova-compute[74934]:     <apic/>
Nov 19 14:48:40 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:40 user nova-compute[74934]:   </features>
Nov 19 14:48:40 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:40 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:40 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:40 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:40 user nova-compute[74934]:   </clock>
Nov 19 14:48:40 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:40 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:40 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:40 user nova-compute[74934]:   </cpu>
Nov 19 14:48:40 user nova-compute[74934]:   <devices>
Nov 19 14:48:40 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:40 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:40 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk"/>
Nov 19 14:48:40 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:40 user nova-compute[74934]:     </disk>
Nov 19 14:48:40 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:40 user nova-compute[74934]:       <mac address="fa:16:3e:09:58:ef"/>
Nov 19 14:48:40 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:40 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:40 user nova-compute[74934]:       <target dev="tap717622fa-a1"/>
Nov 19 14:48:40 user nova-compute[74934]:     </interface>
Nov 19 14:48:40 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:40 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/console.log" append="off"/>
Nov 19 14:48:40 user nova-compute[74934]:     </serial>
Nov 19 14:48:40 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:40 user nova-compute[74934]:     <video>
Nov 19 14:48:40 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:40 user nova-compute[74934]:     </video>
Nov 19 14:48:40 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:40 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:40 user nova-compute[74934]:     </rng>
Nov 19 14:48:40 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:40 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:40 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:40 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:40 user nova-compute[74934]:   </devices>
Nov 19 14:48:40 user nova-compute[74934]: </domain>
Nov 19 14:48:40 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-821473053',display_name='tempest-TestVolumeSwap-server-821473053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-821473053',id=9,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWVmU5HP3zWRUozy3jQq9bASJyjx/3Oq2HlkLYwAfhZ+Tq3iQg5SIcsEHy59OGcoNIbM+EL0vjaCPjjYQPrUglDFqstjOyZwuSvbw1tJJziRuvOI0lMYu1z27PWXONnHA==',key_name='tempest-keypair-1796979662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='307424c45f2441cea52f6a6474184e9a',ramdisk_id='',reservation_id='r-cejmkbur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-521432732',owner_user_name='tempest-TestVolumeSwap-521432732-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e49caa51459e4cd7a48fec02749c59e4',uuid=60dddb96-ee81-4cc8-8960-7e0189d4543b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Converting VIF {"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG os_vif [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc8a3685-0f3a-594d-8a73-aee7b57c6e16', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717622fa-a1, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap717622fa-a1, col_values=(('qos', UUID('9c0dcea2-a880-4cb4-86a9-f6a6f137cbaa')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap717622fa-a1, col_values=(('external_ids', {'iface-id': '717622fa-a1ff-4988-9e16-f399ba8f9020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:58:ef', 'vm-uuid': '60dddb96-ee81-4cc8-8960-7e0189d4543b'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:40 user nova-compute[74934]: INFO os_vif [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1')
Nov 19 14:48:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] No VIF found with MAC fa:16:3e:09:58:ef, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-69bbda13-1b6b-4101-8ef6-d4d7c0d284cc req-d236942b-fbd6-4df9-89fa-adc61c366540 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-69bbda13-1b6b-4101-8ef6-d4d7c0d284cc req-d236942b-fbd6-4df9-89fa-adc61c366540 service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-69bbda13-1b6b-4101-8ef6-d4d7c0d284cc req-d236942b-fbd6-4df9-89fa-adc61c366540 service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-69bbda13-1b6b-4101-8ef6-d4d7c0d284cc req-d236942b-fbd6-4df9-89fa-adc61c366540 service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-69bbda13-1b6b-4101-8ef6-d4d7c0d284cc req-d236942b-fbd6-4df9-89fa-adc61c366540 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:41 user nova-compute[74934]: WARNING nova.compute.manager [req-69bbda13-1b6b-4101-8ef6-d4d7c0d284cc req-d236942b-fbd6-4df9-89fa-adc61c366540 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state active and task_state None.
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-changed-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Refreshing instance network info cache due to event network-changed-717622fa-a1ff-4988-9e16-f399ba8f9020. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] Acquiring lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] Acquired lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Refreshing network info cache for port 717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updated VIF entry in instance network info cache for port 717622fa-a1ff-4988-9e16-f399ba8f9020. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updating instance_info_cache with network_info: [{"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb3900dd-b014-42eb-be5d-38d8cc25bd09 req-626c43c2-9684-49cf-84b5-c1d3a62a91d3 service nova] Releasing lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-e7175785-7ae1-4439-a5ad-35bba391488c req-0f8f8e9d-85c1-41a2-a40f-2532304a0e96 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e7175785-7ae1-4439-a5ad-35bba391488c req-0f8f8e9d-85c1-41a2-a40f-2532304a0e96 service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e7175785-7ae1-4439-a5ad-35bba391488c req-0f8f8e9d-85c1-41a2-a40f-2532304a0e96 service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e7175785-7ae1-4439-a5ad-35bba391488c req-0f8f8e9d-85c1-41a2-a40f-2532304a0e96 service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-e7175785-7ae1-4439-a5ad-35bba391488c req-0f8f8e9d-85c1-41a2-a40f-2532304a0e96 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:43 user nova-compute[74934]: WARNING nova.compute.manager [req-e7175785-7ae1-4439-a5ad-35bba391488c req-0f8f8e9d-85c1-41a2-a40f-2532304a0e96 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state active and task_state None.
Nov 19 14:48:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-e19504c1-5902-45f8-bd69-38a53fc8d3a2 req-2d018604-41a0-4a43-8d72-826c07c97a36 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e19504c1-5902-45f8-bd69-38a53fc8d3a2 req-2d018604-41a0-4a43-8d72-826c07c97a36 service nova] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e19504c1-5902-45f8-bd69-38a53fc8d3a2 req-2d018604-41a0-4a43-8d72-826c07c97a36 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e19504c1-5902-45f8-bd69-38a53fc8d3a2 req-2d018604-41a0-4a43-8d72-826c07c97a36 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-e19504c1-5902-45f8-bd69-38a53fc8d3a2 req-2d018604-41a0-4a43-8d72-826c07c97a36 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] No waiting events found dispatching network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:43 user nova-compute[74934]: WARNING nova.compute.manager [req-e19504c1-5902-45f8-bd69-38a53fc8d3a2 req-2d018604-41a0-4a43-8d72-826c07c97a36 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received unexpected event network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 for instance with vm_state active and task_state None.
Nov 19 14:48:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:44 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:44 user nova-compute[74934]: INFO nova.compute.claims [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Claim successful on node user
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Instance spawned successfully.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] No waiting events found dispatching network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:45 user nova-compute[74934]: WARNING nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received unexpected event network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 for instance with vm_state active and task_state None.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:45 user nova-compute[74934]: WARNING nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 for instance with vm_state building and task_state spawning.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:45 user nova-compute[74934]: WARNING nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 for instance with vm_state building and task_state spawning.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] No waiting events found dispatching network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:45 user nova-compute[74934]: WARNING nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received unexpected event network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 for instance with vm_state building and task_state spawning.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] No waiting events found dispatching network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:45 user nova-compute[74934]: WARNING nova.compute.manager [req-0da331df-6179-4680-aa2e-ac831dd4b33f req-5041cbea-fba5-429a-8955-4ff080f5dc98 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received unexpected event network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 for instance with vm_state building and task_state spawning.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Instance spawned successfully.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.023s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:45 user nova-compute[74934]: INFO nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Took 10.22 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:48:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:48:46 user nova-compute[74934]: INFO nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Took 7.56 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:48:46 user nova-compute[74934]: INFO nova.compute.manager [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Took 11.74 seconds to build instance.
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e91d3ca4-71f8-47ed-ae14-9cdf87aa0a18 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.882s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.policy [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad30f14adf55433aa9164681e70e846a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dddf2b6ce6430588213024af4d9096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:48:46 user nova-compute[74934]: INFO nova.compute.manager [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Took 8.84 seconds to build instance.
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1f9bb4d-a44a-437a-a403-759f499ab174 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.127s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:48:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Creating image(s)
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "/opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "/opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.253s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk 1073741824" returned: 0 in 0.135s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:46 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Successfully created port: b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.330s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-793aa282-8fa3-4e7a-bb7d-8e27025e9c9e req-cfe64c79-7fdb-4c4c-8153-76a698c37111 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-793aa282-8fa3-4e7a-bb7d-8e27025e9c9e req-cfe64c79-7fdb-4c4c-8153-76a698c37111 service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-793aa282-8fa3-4e7a-bb7d-8e27025e9c9e req-cfe64c79-7fdb-4c4c-8153-76a698c37111 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-793aa282-8fa3-4e7a-bb7d-8e27025e9c9e req-cfe64c79-7fdb-4c4c-8153-76a698c37111 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-793aa282-8fa3-4e7a-bb7d-8e27025e9c9e req-cfe64c79-7fdb-4c4c-8153-76a698c37111 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:47 user nova-compute[74934]: WARNING nova.compute.manager [req-793aa282-8fa3-4e7a-bb7d-8e27025e9c9e req-cfe64c79-7fdb-4c4c-8153-76a698c37111 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state active and task_state None.
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.565s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Cannot resize image /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Ensure instance console log exists: /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Skipping network cache update for instance because it is Building. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Successfully updated port: b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquired lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-changed-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Refreshing instance network info cache due to event network-changed-b687d602-81e2-4dab-bca7-db920bdf634b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:48:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] Acquiring lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updating instance_info_cache with network_info: [{"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Releasing lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Instance network_info: |[{"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] Acquired lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Refreshing network info cache for port b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Start _get_guest_xml network_info=[{"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:48:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-4377c585-1fa6-4760-ad45-3b5be0c1f533 req-6eeef830-fbd8-42f1-a5ba-10a030f876ec service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4377c585-1fa6-4760-ad45-3b5be0c1f533 req-6eeef830-fbd8-42f1-a5ba-10a030f876ec service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4377c585-1fa6-4760-ad45-3b5be0c1f533 req-6eeef830-fbd8-42f1-a5ba-10a030f876ec service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4377c585-1fa6-4760-ad45-3b5be0c1f533 req-6eeef830-fbd8-42f1-a5ba-10a030f876ec service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-4377c585-1fa6-4760-ad45-3b5be0c1f533 req-6eeef830-fbd8-42f1-a5ba-10a030f876ec service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:49 user nova-compute[74934]: WARNING nova.compute.manager [req-4377c585-1fa6-4760-ad45-3b5be0c1f533 req-6eeef830-fbd8-42f1-a5ba-10a030f876ec service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state active and task_state None.
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1853069119',display_name='tempest-VolumesAssistedSnapshotsTest-server-1853069119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1853069119',id=10,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHOteLrU6m3vEkQFbtYyEmAj9Aj7z+pBxDLtWPSyWPqk4BqjMfZRafoxO4EseJdBd2AElHaQJdhIg+kwyK11Qijftwy/OBj7LLuUu2FL+5n1niRfY6PRn5ZMJL98We5XQ==',key_name='tempest-keypair-1286933828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13dddf2b6ce6430588213024af4d9096',ramdisk_id='',reservation_id='r-sl3k5bla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-212568249',owner_user_name='tempest-VolumesAssistedSnapshotsTest-212568249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad30f14adf55433aa9164681e70e846a',uuid=bc1c6696-09e5-487d-a9bf-0530f2fc5295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Converting VIF {"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lazy-loading 'pci_devices' on Instance uuid bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:48:49 user nova-compute[74934]:   <uuid>bc1c6696-09e5-487d-a9bf-0530f2fc5295</uuid>
Nov 19 14:48:49 user nova-compute[74934]:   <name>instance-0000000a</name>
Nov 19 14:48:49 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:48:49 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:48:49 user nova-compute[74934]:   <metadata>
Nov 19 14:48:49 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:48:49 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:48:49 user nova-compute[74934]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1853069119</nova:name>
Nov 19 14:48:49 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:48:49</nova:creationTime>
Nov 19 14:48:49 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:48:49 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:48:49 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:48:49 user nova-compute[74934]:       <nova:owner>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:user uuid="ad30f14adf55433aa9164681e70e846a">tempest-VolumesAssistedSnapshotsTest-212568249-project-member</nova:user>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:project uuid="13dddf2b6ce6430588213024af4d9096">tempest-VolumesAssistedSnapshotsTest-212568249</nova:project>
Nov 19 14:48:49 user nova-compute[74934]:       </nova:owner>
Nov 19 14:48:49 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:48:49 user nova-compute[74934]:       <nova:ports>
Nov 19 14:48:49 user nova-compute[74934]:         <nova:port uuid="b687d602-81e2-4dab-bca7-db920bdf634b">
Nov 19 14:48:49 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 19 14:48:49 user nova-compute[74934]:         </nova:port>
Nov 19 14:48:49 user nova-compute[74934]:       </nova:ports>
Nov 19 14:48:49 user nova-compute[74934]:     </nova:instance>
Nov 19 14:48:49 user nova-compute[74934]:   </metadata>
Nov 19 14:48:49 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:48:49 user nova-compute[74934]:     <system>
Nov 19 14:48:49 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:48:49 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:48:49 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:48:49 user nova-compute[74934]:       <entry name="serial">bc1c6696-09e5-487d-a9bf-0530f2fc5295</entry>
Nov 19 14:48:49 user nova-compute[74934]:       <entry name="uuid">bc1c6696-09e5-487d-a9bf-0530f2fc5295</entry>
Nov 19 14:48:49 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:48:49 user nova-compute[74934]:     </system>
Nov 19 14:48:49 user nova-compute[74934]:   </sysinfo>
Nov 19 14:48:49 user nova-compute[74934]:   <os>
Nov 19 14:48:49 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:48:49 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:48:49 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:48:49 user nova-compute[74934]:   </os>
Nov 19 14:48:49 user nova-compute[74934]:   <features>
Nov 19 14:48:49 user nova-compute[74934]:     <acpi/>
Nov 19 14:48:49 user nova-compute[74934]:     <apic/>
Nov 19 14:48:49 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:48:49 user nova-compute[74934]:   </features>
Nov 19 14:48:49 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:48:49 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:48:49 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:48:49 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:48:49 user nova-compute[74934]:   </clock>
Nov 19 14:48:49 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:48:49 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:48:49 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:48:49 user nova-compute[74934]:   </cpu>
Nov 19 14:48:49 user nova-compute[74934]:   <devices>
Nov 19 14:48:49 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:48:49 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:48:49 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk"/>
Nov 19 14:48:49 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:48:49 user nova-compute[74934]:     </disk>
Nov 19 14:48:49 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:48:49 user nova-compute[74934]:       <mac address="fa:16:3e:36:f6:86"/>
Nov 19 14:48:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:49 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:48:49 user nova-compute[74934]:       <target dev="tapb687d602-81"/>
Nov 19 14:48:49 user nova-compute[74934]:     </interface>
Nov 19 14:48:49 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:48:49 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/console.log" append="off"/>
Nov 19 14:48:49 user nova-compute[74934]:     </serial>
Nov 19 14:48:49 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:48:49 user nova-compute[74934]:     <video>
Nov 19 14:48:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:48:49 user nova-compute[74934]:     </video>
Nov 19 14:48:49 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:48:49 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:48:49 user nova-compute[74934]:     </rng>
Nov 19 14:48:49 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:48:49 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:48:49 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:48:49 user nova-compute[74934]:     </memballoon>
Nov 19 14:48:49 user nova-compute[74934]:   </devices>
Nov 19 14:48:49 user nova-compute[74934]: </domain>
Nov 19 14:48:49 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1853069119',display_name='tempest-VolumesAssistedSnapshotsTest-server-1853069119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1853069119',id=10,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHOteLrU6m3vEkQFbtYyEmAj9Aj7z+pBxDLtWPSyWPqk4BqjMfZRafoxO4EseJdBd2AElHaQJdhIg+kwyK11Qijftwy/OBj7LLuUu2FL+5n1niRfY6PRn5ZMJL98We5XQ==',key_name='tempest-keypair-1286933828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13dddf2b6ce6430588213024af4d9096',ramdisk_id='',reservation_id='r-sl3k5bla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-212568249',owner_user_name='tempest-VolumesAssistedSnapshotsTest-212568249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad30f14adf55433aa9164681e70e846a',uuid=bc1c6696-09e5-487d-a9bf-0530f2fc5295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Converting VIF {"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG os_vif [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eccaa93f-47b1-59ec-9d01-04cb13676ff9', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb687d602-81, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb687d602-81, col_values=(('qos', UUID('68c88b6b-8ff7-48bd-a073-2bb37e40d09e')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb687d602-81, col_values=(('external_ids', {'iface-id': 'b687d602-81e2-4dab-bca7-db920bdf634b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f6:86', 'vm-uuid': 'bc1c6696-09e5-487d-a9bf-0530f2fc5295'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:48:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:49 user nova-compute[74934]: INFO os_vif [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81')
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] No VIF found with MAC fa:16:3e:36:f6:86, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updated VIF entry in instance network info cache for port b687d602-81e2-4dab-bca7-db920bdf634b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updating instance_info_cache with network_info: [{"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:48:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-36c0542a-004f-4f8f-9452-49f41fb1a0dc req-4ab7009a-e6e2-4c6a-9b02-7fb481403152 service nova] Releasing lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:48:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-405f971d-4eb3-49e7-b532-3590bbac3da9 req-28ade3a5-f251-4f72-a7c9-86c26515c068 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-405f971d-4eb3-49e7-b532-3590bbac3da9 req-28ade3a5-f251-4f72-a7c9-86c26515c068 service nova] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-405f971d-4eb3-49e7-b532-3590bbac3da9 req-28ade3a5-f251-4f72-a7c9-86c26515c068 service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-405f971d-4eb3-49e7-b532-3590bbac3da9 req-28ade3a5-f251-4f72-a7c9-86c26515c068 service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-405f971d-4eb3-49e7-b532-3590bbac3da9 req-28ade3a5-f251-4f72-a7c9-86c26515c068 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] No waiting events found dispatching network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:52 user nova-compute[74934]: WARNING nova.compute.manager [req-405f971d-4eb3-49e7-b532-3590bbac3da9 req-28ade3a5-f251-4f72-a7c9-86c26515c068 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received unexpected event network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b for instance with vm_state building and task_state spawning.
Nov 19 14:48:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-74edaaa1-d935-4aee-a40a-ef8e0a176f3d req-489338c5-3bc6-49ac-8901-5eb124923f7a service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-74edaaa1-d935-4aee-a40a-ef8e0a176f3d req-489338c5-3bc6-49ac-8901-5eb124923f7a service nova] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-74edaaa1-d935-4aee-a40a-ef8e0a176f3d req-489338c5-3bc6-49ac-8901-5eb124923f7a service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-74edaaa1-d935-4aee-a40a-ef8e0a176f3d req-489338c5-3bc6-49ac-8901-5eb124923f7a service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-74edaaa1-d935-4aee-a40a-ef8e0a176f3d req-489338c5-3bc6-49ac-8901-5eb124923f7a service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] No waiting events found dispatching network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:54 user nova-compute[74934]: WARNING nova.compute.manager [req-74edaaa1-d935-4aee-a40a-ef8e0a176f3d req-489338c5-3bc6-49ac-8901-5eb124923f7a service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received unexpected event network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b for instance with vm_state building and task_state spawning.
Nov 19 14:48:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:48:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:48:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Instance spawned successfully.
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:55 user nova-compute[74934]: INFO nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Took 9.03 seconds to spawn the instance on the hypervisor.
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-b41af20d-9d85-4a18-b3e9-393e97314d9d req-a9aa6780-63fa-47da-9054-995088e32083 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b41af20d-9d85-4a18-b3e9-393e97314d9d req-a9aa6780-63fa-47da-9054-995088e32083 service nova] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b41af20d-9d85-4a18-b3e9-393e97314d9d req-a9aa6780-63fa-47da-9054-995088e32083 service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b41af20d-9d85-4a18-b3e9-393e97314d9d req-a9aa6780-63fa-47da-9054-995088e32083 service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-b41af20d-9d85-4a18-b3e9-393e97314d9d req-a9aa6780-63fa-47da-9054-995088e32083 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] No waiting events found dispatching network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:55 user nova-compute[74934]: WARNING nova.compute.manager [req-b41af20d-9d85-4a18-b3e9-393e97314d9d req-a9aa6780-63fa-47da-9054-995088e32083 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received unexpected event network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e for instance with vm_state active and task_state None.
Nov 19 14:48:55 user nova-compute[74934]: INFO nova.compute.manager [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Took 10.66 seconds to build instance.
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8bebd458-58d2-400e-a9c0-e7e8d50866c3 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.821s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.519s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-477d0126-ab22-4d3b-9255-00fb5ea07ac5 req-becb3434-3709-44e4-8f04-782f61abb445 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-477d0126-ab22-4d3b-9255-00fb5ea07ac5 req-becb3434-3709-44e4-8f04-782f61abb445 service nova] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-477d0126-ab22-4d3b-9255-00fb5ea07ac5 req-becb3434-3709-44e4-8f04-782f61abb445 service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-477d0126-ab22-4d3b-9255-00fb5ea07ac5 req-becb3434-3709-44e4-8f04-782f61abb445 service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-477d0126-ab22-4d3b-9255-00fb5ea07ac5 req-becb3434-3709-44e4-8f04-782f61abb445 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] No waiting events found dispatching network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:48:57 user nova-compute[74934]: WARNING nova.compute.manager [req-477d0126-ab22-4d3b-9255-00fb5ea07ac5 req-becb3434-3709-44e4-8f04-782f61abb445 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received unexpected event network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e for instance with vm_state active and task_state None.
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:48:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7617MB free_disk=25.658187866210938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60dddb96-ee81-4cc8-8960-7e0189d4543b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b7614315-a839-4dbf-8137-9b4a096bea5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 8b33af6a-67df-485c-84d9-ce224f78e67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:48:58 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "2764ee50-8167-4303-af46-c15e6e354f81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.160s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.393s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:48:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:48:59 user nova-compute[74934]: INFO nova.compute.claims [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Claim successful on node user
Nov 19 14:48:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:49:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:49:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Creating image(s)
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "/opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "/opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "/opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG nova.policy [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff2ce81d95784e2ca1a7ed417aec0ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9faa940e4d1f4cd2a0d6326c982c3f57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk 1073741824" returned: 0 in 0.070s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Cannot resize image /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Ensure instance console log exists: /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Successfully created port: 87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Successfully updated port: 87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "refresh_cache-2764ee50-8167-4303-af46-c15e6e354f81" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquired lock "refresh_cache-2764ee50-8167-4303-af46-c15e6e354f81" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-changed-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Refreshing instance network info cache due to event network-changed-87bd824d-cf90-4a95-8898-b9227a626ff9. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] Acquiring lock "refresh_cache-2764ee50-8167-4303-af46-c15e6e354f81" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Updating instance_info_cache with network_info: [{"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Releasing lock "refresh_cache-2764ee50-8167-4303-af46-c15e6e354f81" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Instance network_info: |[{"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] Acquired lock "refresh_cache-2764ee50-8167-4303-af46-c15e6e354f81" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.neutron [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Refreshing network info cache for port 87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Start _get_guest_xml network_info=[{"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:49:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1883692123',display_name='tempest-VolumesNegativeTest-instance-1883692123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1883692123',id=11,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9faa940e4d1f4cd2a0d6326c982c3f57',ramdisk_id='',reservation_id='r-hgrauau8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1661661215',owner_user_name='tempest-VolumesNegativeTest-1661661215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:00Z,user_data=None,user_id='ff2ce81d95784e2ca1a7ed417aec0ad3',uuid=2764ee50-8167-4303-af46-c15e6e354f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Converting VIF {"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lazy-loading 'pci_devices' on Instance uuid 2764ee50-8167-4303-af46-c15e6e354f81 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:49:03 user nova-compute[74934]:   <uuid>2764ee50-8167-4303-af46-c15e6e354f81</uuid>
Nov 19 14:49:03 user nova-compute[74934]:   <name>instance-0000000b</name>
Nov 19 14:49:03 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:49:03 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:49:03 user nova-compute[74934]:   <metadata>
Nov 19 14:49:03 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:49:03 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:49:03 user nova-compute[74934]:       <nova:name>tempest-VolumesNegativeTest-instance-1883692123</nova:name>
Nov 19 14:49:03 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:49:03</nova:creationTime>
Nov 19 14:49:03 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:49:03 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:49:03 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:49:03 user nova-compute[74934]:       <nova:owner>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:user uuid="ff2ce81d95784e2ca1a7ed417aec0ad3">tempest-VolumesNegativeTest-1661661215-project-member</nova:user>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:project uuid="9faa940e4d1f4cd2a0d6326c982c3f57">tempest-VolumesNegativeTest-1661661215</nova:project>
Nov 19 14:49:03 user nova-compute[74934]:       </nova:owner>
Nov 19 14:49:03 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:49:03 user nova-compute[74934]:       <nova:ports>
Nov 19 14:49:03 user nova-compute[74934]:         <nova:port uuid="87bd824d-cf90-4a95-8898-b9227a626ff9">
Nov 19 14:49:03 user nova-compute[74934]:           <nova:ip type="fixed" address="192.168.233.163" ipVersion="4"/>
Nov 19 14:49:03 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:03 user nova-compute[74934]:       </nova:ports>
Nov 19 14:49:03 user nova-compute[74934]:     </nova:instance>
Nov 19 14:49:03 user nova-compute[74934]:   </metadata>
Nov 19 14:49:03 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:49:03 user nova-compute[74934]:     <system>
Nov 19 14:49:03 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:49:03 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:49:03 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:49:03 user nova-compute[74934]:       <entry name="serial">2764ee50-8167-4303-af46-c15e6e354f81</entry>
Nov 19 14:49:03 user nova-compute[74934]:       <entry name="uuid">2764ee50-8167-4303-af46-c15e6e354f81</entry>
Nov 19 14:49:03 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:49:03 user nova-compute[74934]:     </system>
Nov 19 14:49:03 user nova-compute[74934]:   </sysinfo>
Nov 19 14:49:03 user nova-compute[74934]:   <os>
Nov 19 14:49:03 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:49:03 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:49:03 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:49:03 user nova-compute[74934]:   </os>
Nov 19 14:49:03 user nova-compute[74934]:   <features>
Nov 19 14:49:03 user nova-compute[74934]:     <acpi/>
Nov 19 14:49:03 user nova-compute[74934]:     <apic/>
Nov 19 14:49:03 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:49:03 user nova-compute[74934]:   </features>
Nov 19 14:49:03 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:49:03 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:49:03 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:49:03 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:49:03 user nova-compute[74934]:   </clock>
Nov 19 14:49:03 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:49:03 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:49:03 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:49:03 user nova-compute[74934]:   </cpu>
Nov 19 14:49:03 user nova-compute[74934]:   <devices>
Nov 19 14:49:03 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:49:03 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:49:03 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk"/>
Nov 19 14:49:03 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:49:03 user nova-compute[74934]:     </disk>
Nov 19 14:49:03 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:03 user nova-compute[74934]:       <mac address="fa:16:3e:6f:ec:7d"/>
Nov 19 14:49:03 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:03 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:03 user nova-compute[74934]:       <target dev="tap87bd824d-cf"/>
Nov 19 14:49:03 user nova-compute[74934]:     </interface>
Nov 19 14:49:03 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:49:03 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/console.log" append="off"/>
Nov 19 14:49:03 user nova-compute[74934]:     </serial>
Nov 19 14:49:03 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:49:03 user nova-compute[74934]:     <video>
Nov 19 14:49:03 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:03 user nova-compute[74934]:     </video>
Nov 19 14:49:03 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:49:03 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:49:03 user nova-compute[74934]:     </rng>
Nov 19 14:49:03 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:49:03 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:49:03 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:49:03 user nova-compute[74934]:     </memballoon>
Nov 19 14:49:03 user nova-compute[74934]:   </devices>
Nov 19 14:49:03 user nova-compute[74934]: </domain>
Nov 19 14:49:03 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1883692123',display_name='tempest-VolumesNegativeTest-instance-1883692123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1883692123',id=11,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9faa940e4d1f4cd2a0d6326c982c3f57',ramdisk_id='',reservation_id='r-hgrauau8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1661661215',owner_user_name='tempest-VolumesNegativeTest-1661661215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:00Z,user_data=None,user_id='ff2ce81d95784e2ca1a7ed417aec0ad3',uuid=2764ee50-8167-4303-af46-c15e6e354f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Converting VIF {"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG os_vif [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1692c89c-da3b-5a84-9fb3-861e565cc3ba', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87bd824d-cf, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87bd824d-cf, col_values=(('qos', UUID('809b242f-9de2-422b-b021-845394321c1f')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87bd824d-cf, col_values=(('external_ids', {'iface-id': '87bd824d-cf90-4a95-8898-b9227a626ff9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:ec:7d', 'vm-uuid': '2764ee50-8167-4303-af46-c15e6e354f81'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:03 user nova-compute[74934]: INFO os_vif [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf')
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] No VIF found with MAC fa:16:3e:6f:ec:7d, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:49:04 user nova-compute[74934]: DEBUG nova.network.neutron [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Updated VIF entry in instance network info cache for port 87bd824d-cf90-4a95-8898-b9227a626ff9. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:04 user nova-compute[74934]: DEBUG nova.network.neutron [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Updating instance_info_cache with network_info: [{"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c416351-bd6d-40d8-a836-ba6575600a0b req-863fe81c-c0c3-449d-92da-1193bdde05e7 service nova] Releasing lock "refresh_cache-2764ee50-8167-4303-af46-c15e6e354f81" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-833049ce-c4e1-495e-a98a-e4d0678a6542 req-d2af6ce9-c56a-4ede-ae64-4614070c9dda service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-833049ce-c4e1-495e-a98a-e4d0678a6542 req-d2af6ce9-c56a-4ede-ae64-4614070c9dda service nova] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-833049ce-c4e1-495e-a98a-e4d0678a6542 req-d2af6ce9-c56a-4ede-ae64-4614070c9dda service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-833049ce-c4e1-495e-a98a-e4d0678a6542 req-d2af6ce9-c56a-4ede-ae64-4614070c9dda service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-833049ce-c4e1-495e-a98a-e4d0678a6542 req-d2af6ce9-c56a-4ede-ae64-4614070c9dda service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] No waiting events found dispatching network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:05 user nova-compute[74934]: WARNING nova.compute.manager [req-833049ce-c4e1-495e-a98a-e4d0678a6542 req-d2af6ce9-c56a-4ede-ae64-4614070c9dda service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received unexpected event network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 for instance with vm_state building and task_state spawning.
Nov 19 14:49:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:49:06 user nova-compute[74934]: INFO nova.compute.claims [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Claim successful on node user
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:49:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:49:07 user nova-compute[74934]: INFO nova.compute.claims [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Claim successful on node user
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:49:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Instance spawned successfully.
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:07 user nova-compute[74934]: INFO nova.virt.block_device [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Booting with volume 33f1fce9-2d60-42ff-80e8-fd18c7bc03eb at /dev/vda
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.policy [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66a341a079864dfca3bf3648612bc39e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120a65aa7a6240b48adf7b7f8c76c8a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [req-0ed172f4-370e-4e67-a767-9b9920a047d6 req-2e5c8305-f8f7-4c5e-afcf-4390c379e071 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0ed172f4-370e-4e67-a767-9b9920a047d6 req-2e5c8305-f8f7-4c5e-afcf-4390c379e071 service nova] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0ed172f4-370e-4e67-a767-9b9920a047d6 req-2e5c8305-f8f7-4c5e-afcf-4390c379e071 service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0ed172f4-370e-4e67-a767-9b9920a047d6 req-2e5c8305-f8f7-4c5e-afcf-4390c379e071 service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [req-0ed172f4-370e-4e67-a767-9b9920a047d6 req-2e5c8305-f8f7-4c5e-afcf-4390c379e071 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] No waiting events found dispatching network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:07 user nova-compute[74934]: WARNING nova.compute.manager [req-0ed172f4-370e-4e67-a767-9b9920a047d6 req-2e5c8305-f8f7-4c5e-afcf-4390c379e071 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received unexpected event network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 for instance with vm_state building and task_state spawning.
Nov 19 14:49:07 user nova-compute[74934]: DEBUG os_brick.utils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:07 user nova-compute[74934]: INFO oslo.privsep.daemon [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgikww8av/privsep.sock']
Nov 19 14:49:07 user nova-compute[74934]: INFO nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 19 14:49:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:49:07 user sudo[86316]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgikww8av/privsep.sock
Nov 19 14:49:07 user sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 19 14:49:07 user nova-compute[74934]: INFO nova.compute.manager [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Took 8.73 seconds to build instance.
Nov 19 14:49:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-263982bd-50e3-4af9-ab2c-cd8c97b92b2d tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "2764ee50-8167-4303-af46-c15e6e354f81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.854s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully created port: 9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:49:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:49:08 user nova-compute[74934]: INFO nova.virt.block_device [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Booting with volume d1bbbe24-64d5-46c7-8f55-739be2de4fe3 at /dev/vda
Nov 19 14:49:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.policy [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f2967d573604485b044645974acb084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62a01e157ea24e1fa6dd189e26aad897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully created port: aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:09 user sudo[86316]: pam_unix(sudo:session): session closed for user root
Nov 19 14:49:09 user nova-compute[74934]: INFO oslo.privsep.daemon [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Spawned new privsep daemon via rootwrap
Nov 19 14:49:09 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 19 14:49:09 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 19 14:49:09 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 19 14:49:09 user nova-compute[74934]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86319
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a7750-041a-4ccc-84d7-5e4a75f837f9]: (2,) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: WARNING oslo_privsep.priv_context [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] privsep daemon already running
Nov 19 14:49:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully created port: 1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully created port: 363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[237de244-3f66-4714-98dd-7fc0b47b25f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c3b546-4e92-41f8-93c3-e319699fd085]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: WARNING os_brick.initiator.connectors.nvmeof [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1650d874-3536-48df-94e1-ff403c968501]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[538cf902-04db-444b-bc55-c6a0a4f86526]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c307cb7-a12f-4bdd-be9c-50922e7413c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d6526d-06ff-48a8-9c8b-a833b9a63dd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bebbd1d-d5b7-46b7-98a3-1dd3164d90d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9689192-394b-4541-8366-6948b501dce9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:09 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c76d008-2cb3-439d-be81-6ffa01de2e33]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== get_connector_properties: return (1145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating existing volume attachment record: 34de0649-64a8-4fed-99f4-534daa3fa42a {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:09 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:49:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad91ab85-9ba4-4c7e-b34f-a9d61b07715d]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG os_brick.utils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== get_connector_properties: return (1945ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating existing volume attachment record: 460c42a8-f5e8-429a-bc2d-135511e1880f {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:49:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully created port: a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully created port: d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully created port: 4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully created port: 36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully created port: 02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: 9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-9ded98a8-0885-42aa-9a15-9601389e55b8. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port 9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully created port: 620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: 53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73eaa4f5-1744-4010-afae-3f4f540dad0e req-ce3167df-b20e-430e-95ed-0c4b529b5238 service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-53aee27f-edaa-4397-a44a-abe0e0df7af9. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port 53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: 1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-1a4a6bac-437f-425d-8bd1-3703b536e668. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c20e616d-9b9f-4ada-8889-71554c270091 req-74ab81cb-d13e-4caf-bc70-a8e374d13129 service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f14abf4-c852-45da-97f8-45f63291c325 req-fc494134-2f12-4372-9558-797068a26d7d service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: 8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: 440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: 31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-8585d586-26ae-480e-b6f6-a0fc57b07350. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port 8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-440e714d-4e02-4421-810f-891e5769473a. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: 363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-de03318e-728e-4e18-9972-ef11fb62559c req-004735be-178a-4903-988d-a53456b96f6f service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c602b778-3ede-4494-bb34-cfffed2fa5cb req-6083d648-4601-4251-8a3a-8138e4337958 service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:16 user nova-compute[74934]: INFO nova.virt.block_device [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Booting with volume d9019cdf-28d1-41c8-a295-dddb49bae5da at /dev/vdb
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Successfully updated port: 36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f76239-908b-4a8b-9978-565c45d877b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c4cab9-239f-4a60-b38b-f8ea7b868578]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: INFO nova.virt.block_device [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Booting with volume 4098aa71-7717-4be5-bbb9-597216910dce at /dev/vdb
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: 4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a522c-6226-4fad-9d62-11340193e786]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c3cef-966c-4f96-a913-d5e93369c38a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.utils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[433fe397-45fd-4374-b79d-8e5a625bb0f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:16 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4fcfd9-7060-4da6-9a6b-90f5cf3c18a7]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating existing volume attachment record: 197fd4d7-8286-464e-8845-1350e102d1f6 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5437c81e-9f0d-4504-acef-66c501dbdda8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[22434ae9-20f0-403e-bf3f-913755443812]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f35ae-e41b-49b5-b015-9d7edde64812]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:16 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e5697-b24d-49db-a351-5f2e297d3d61]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG os_brick.utils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating existing volume attachment record: 16cfd1d0-f60d-48c7-abe1-244dab5c1018 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-363ddf7b-3263-4367-9825-ea96fbc7c078. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-a1992673-172b-4bcc-b293-cd0dc830f205. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.network.neutron [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:16 user nova-compute[74934]: DEBUG nova.network.neutron [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-4eb5b190-be80-42cf-b92b-4ac2a56cf627. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: 02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ce2d9520-5a73-4a68-9ba1-718bd09832ff req-b7683d63-7b8d-4af3-bea4-a9252fd404f2 service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Successfully updated port: 620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance network_info: |[{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port 363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-02af2d15-9e76-438c-b4da-141a0fa771ca. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updated VIF entry in instance network info cache for port 363ddf7b-3263-4367-9825-ea96fbc7c078. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-d3502927-a1c4-4a60-aa48-0ad21c58eaad. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updated VIF entry in instance network info cache for port d3502927-a1c4-4a60-aa48-0ad21c58eaad. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-36df05dc-e208-4e98-a9e4-593fbf534073. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port 36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updated VIF entry in instance network info cache for port 36df05dc-e208-4e98-a9e4-593fbf534073. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a1823c3c-279f-4778-a652-74a163cfd211 req-a5dfe730-e37c-448b-a9a7-58e97a85064d service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [{"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance network_info: |[{"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updated VIF entry in instance network info cache for port 02af2d15-9e76-438c-b4da-141a0fa771ca. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [{"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-620aa04d-0566-4df8-8c9a-14d5c5eef099. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updated VIF entry in instance network info cache for port 620aa04d-0566-4df8-8c9a-14d5c5eef099. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [{"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-72c0e8d4-0173-4eb4-98c8-0162da2fb94d req-85be1ecf-dca5-475c-8b1f-bc04e5054c2f service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:22 user nova-compute[74934]: INFO nova.virt.block_device [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Booting with volume af782e66-5706-40c1-b1ef-bba5b6dfaa4a at /dev/vdc
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0693aa-8558-4cfa-9ff8-38fe8909b460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[89334eb9-9400-49fa-91b5-f67df7b8b189]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceefe88a-d3fb-4a4e-ba51-ab77b13bf7e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d23e6c-490a-4269-9208-5c08b37fb929]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:22 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f083bb-75f1-4033-89e7-eb74ba35cb13]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating existing volume attachment record: eedef8e4-035b-4e4f-9388-c707b545721c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:49:22 user nova-compute[74934]: INFO nova.virt.block_device [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Booting with volume 9ade7d41-4451-4074-b7f1-475bdc22dc25 at /dev/vdc
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.utils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b9725-4f7d-4d36-b525-0ddea1f8e7ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2656f8b7-9915-4c4b-b298-8de5ff2943b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1f106-c9dd-4d17-95c8-1d688ef0cf93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[47028f2a-bc3c-4662-a313-80d8914138a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:49:22 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:49:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1403c2a0-deae-42a7-b613-242d657908ac]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG os_brick.utils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:22 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating existing volume attachment record: 94dbede5-8bde-4a58-adfd-883250e48faa {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:49:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:49:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Creating image(s)
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Ensure instance console log exists: /opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Start _get_guest_xml network_info=[{"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '34de0649-64a8-4fed-99f4-534daa3fa42a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWpjQvTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1bbbe24-64d5-46c7-8f55-739be2de4fe3', 'serial': 'd1bbbe24-64d5-46c7-8f55-739be2de4fe3'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '197fd4d7-8286-464e-8845-1350e102d1f6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBesMUSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9019cdf-28d1-41c8-a295-dddb49bae5da', 'serial': 'd9019cdf-28d1-41c8-a295-dddb49bae5da'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': 'eedef8e4-035b-4e4f-9388-c707b545721c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKTvkiUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43', 'attached_at': '', 'detached_at': '', 'volume_id': 'af782e66-5706-40c1-b1ef-bba5b6dfaa4a', 'serial': 'af782e66-5706-40c1-b1ef-bba5b6dfaa4a'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:49:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connector [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Factory for ISCSI on None {{(pid=74934) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWpjQvTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:28 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:28 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:28 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa8467b-a207-4fb6-af0d-939458f66db8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:49:28 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4e775-cc2e-49c1-bcb3-f7c8e3e15cc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3] added
Nov 19 14:49:28 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbc34e6-c329-4351-acf2-28bc4922060f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b44bd30-a0c5-43b4-96b6-3c784e69bae4]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWpjQvTJ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWpjQvTJ" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5192b767-721e-4910-9c2f-2e591fef8cdf]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWpjQvTJ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9ca6e-cca8-4453-9eda-6aa32325b77d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa9b62-d7c6-48a2-9075-d44b50e473e6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 14:49:28 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 14:49:28 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:28 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 14:49:28 user nova-compute[74934]: 
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1536ccb6-befc-405a-a6fa-001468851bc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260]
Nov 19 14:49:28 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260] successful.
Nov 19 14:49:28 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418cecc-fcab-4856-8de9-3d7420727049]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0bcc8-d93d-4f77-9ead-f24eb305dff8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:28 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:28 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:49:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Creating image(s)
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Ensure instance console log exists: /opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Start _get_guest_xml network_info=[{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '460c42a8-f5e8-429a-bc2d-135511e1880f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOapjXFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ae17df3-ca5b-432a-8975-7e94b549e19e', 'attached_at': '', 'detached_at': '', 'volume_id': '33f1fce9-2d60-42ff-80e8-fd18c7bc03eb', 'serial': '33f1fce9-2d60-42ff-80e8-fd18c7bc03eb'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'attachment_id': '16cfd1d0-f60d-48c7-abe1-244dab5c1018', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCjGiWIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ae17df3-ca5b-432a-8975-7e94b549e19e', 'attached_at': '', 'detached_at': '', 'volume_id': '4098aa71-7717-4be5-bbb9-597216910dce', 'serial': '4098aa71-7717-4be5-bbb9-597216910dce'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'attachment_id': '94dbede5-8bde-4a58-adfd-883250e48faa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZXBbNPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ae17df3-ca5b-432a-8975-7e94b549e19e', 'attached_at': '', 'detached_at': '', 'volume_id': '9ade7d41-4451-4074-b7f1-475bdc22dc25', 'serial': '9ade7d41-4451-4074-b7f1-475bdc22dc25'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99ffce-c501-4435-b61c-0b1316abd48a]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWpjQvTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:49:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOapjXFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:28 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26537616432353634', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537616432353634', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.952s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:29 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:29 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf69f68-7303-4f00-ba74-a208d1fa4575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:49:29 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBesMUSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:29 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b72ea01-6841-4b97-a77b-d57546c5aabe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb] added
Nov 19 14:49:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[52644d7d-c4ff-45a5-8954-d7c058f07a3b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b61b2-7b9d-46db-b444-3aa8ca397e3b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOapjXFk {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOapjXFk" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1356fdc6-13dc-4e2a-b7af-86a22b1281a4]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xOapjXFk'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a478f1f-544d-4637-81e1-4072d2e77b32]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770b469-9c4c-4ac8-8907-783a83e051b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c4508-0999-494a-8abd-b6123ef52355]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260]
Nov 19 14:49:29 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260] successful.
Nov 19 14:49:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5718da3b-82ca-401e-9e61-32b2ed03af39]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[894be490-a010-4dce-8cab-3e652324aedc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:29 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:29 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5380aa-91f8-42f4-982c-fc96799f1962]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:29 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOapjXFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== connect_volume: return (2229ms) {'type': 'block', 'scsi_wwn': '23030303934303237', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303934303237', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.253s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:30 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:30 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e2588-dc59-4a54-aca6-3ee32d59d46b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:49:30 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCjGiWIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:30 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f22e491-9b9b-46fe-a4b6-fbac219be396]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da] added
Nov 19 14:49:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553b307-f826-40c0-8370-d0d077bca8af]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f887629-c916-4c34-a095-6d013a2be7cb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBesMUSV {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wBesMUSV" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f330122-23cf-4f2e-ba5f-8ed7d873773e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wBesMUSV'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d848d8-9277-4ad0-80c6-e8e54ae29c53]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe6bd27-bed9-40d4-ae6d-208c74dbacdc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:30 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:30 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d9f3b5-76f0-4e52-8743-57ce3fd92cbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260]
Nov 19 14:49:30 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260] successful.
Nov 19 14:49:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe4d99-8de1-43e6-a833-ac55d0c56db0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f086c0e9-16a6-45d9-8fdf-51fc70acbdbe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:31 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:31 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:31 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:31 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:31 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:31 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4507825-8704-40dd-b5d7-5966165ec288]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:31 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBesMUSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== connect_volume: return (2529ms) {'type': 'block', 'scsi_wwn': '26161386133633132', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161386133633132', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.252s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:32 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:32 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9099d012-c833-4618-aee5-6b9a84b6c8fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:49:32 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda3a596-5ac3-46f2-a867-1d31bc9ca531]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce] added
Nov 19 14:49:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c7a70-8c2d-4a72-8677-94ace89bb2de]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.111s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[72501271-6d6c-43d7-a3a3-14020a577993]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKTvkiUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:32 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCjGiWIQ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCjGiWIQ" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bad718-ae79-45ed-8fc0-77c1ab042011]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCjGiWIQ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a96278-9a50-4103-aff9-9c217b71c563]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5769a095-f6ea-430a-9a90-41d65f16c395]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6061a29d-9bce-4018-8b35-d64024eb08c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260]
Nov 19 14:49:32 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260] successful.
Nov 19 14:49:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b00ef0f-5628-4cd4-92cd-6f9c2048ea9f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd18c0b-4c4d-4d9d-ba9a-3b7fb899e12b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:32 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e275ad81-f7bd-4869-b34f-b52f31200ca3]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCjGiWIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== connect_volume: return (2682ms) {'type': 'block', 'scsi_wwn': '23162613966393435', 'path': '/dev/sde'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162613966393435', 'path': '/dev/sde'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.242s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:33 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:33 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZXBbNPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:49:33 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39b92d-4b6b-4bb6-acc4-a5af2563df01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:49:33 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bdd6d5-0f52-46a4-b7a6-e911d33ef738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a] added
Nov 19 14:49:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d9c0a-bf8c-4aaa-8b6c-92bba80dcfc0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd2f86d-ef61-400b-a556-0bbb407afce3]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKTvkiUI {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKTvkiUI" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b784f-98ed-455d-8a80-692bb33d85a0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sKTvkiUI'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afeb225-8d7a-4d50-aba2-1b6b44946eab]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6dcb0d-ff17-4b87-9253-150ad6a02244]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7583a47e-cc3f-4c02-8c1b-c67c9f42981b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260]
Nov 19 14:49:33 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260] successful.
Nov 19 14:49:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a5da1a-cbe5-4a33-80ed-cec1ce6d6e0f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eba23b-c305-4ed0-ad33-c39fa1a6fca7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:49:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:33 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:49:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e033282e-3211-430f-bb90-f9759621194c]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKTvkiUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== connect_volume: return (2546ms) {'type': 'block', 'scsi_wwn': '23733306239366164', 'path': '/dev/sdf'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733306239366164', 'path': '/dev/sdf'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.281s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:34 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:49:34 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lazy-loading 'pci_devices' on Instance uuid a5ed99bc-03bb-48f8-ab95-9c79adf3fe43 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3238f5af-ded7-4d9d-9a17-bc5ad2ec48b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:49:34 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:49:34 user nova-compute[74934]:   <uuid>a5ed99bc-03bb-48f8-ab95-9c79adf3fe43</uuid>
Nov 19 14:49:34 user nova-compute[74934]:   <name>instance-0000000d</name>
Nov 19 14:49:34 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:49:34 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:49:34 user nova-compute[74934]:   <metadata>
Nov 19 14:49:34 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:49:34 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:49:34 user nova-compute[74934]:       <nova:name>tempest-device-tagging-server-1564852900</nova:name>
Nov 19 14:49:34 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:49:28</nova:creationTime>
Nov 19 14:49:34 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:49:34 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:49:34 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:49:34 user nova-compute[74934]:       <nova:owner>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:user uuid="8f2967d573604485b044645974acb084">tempest-TaggedBootDevicesTest_v242-2013958253-project-member</nova:user>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:project uuid="62a01e157ea24e1fa6dd189e26aad897">tempest-TaggedBootDevicesTest_v242-2013958253</nova:project>
Nov 19 14:49:34 user nova-compute[74934]:       </nova:owner>
Nov 19 14:49:34 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:49:34 user nova-compute[74934]:       <nova:ports>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="1a4a6bac-437f-425d-8bd1-3703b536e668">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="440e714d-4e02-4421-810f-891e5769473a">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="31e81ef7-a125-4d8a-9adc-ace52dfcc5b3">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="a1992673-172b-4bcc-b293-cd0dc830f205">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="4eb5b190-be80-42cf-b92b-4ac2a56cf627">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="02af2d15-9e76-438c-b4da-141a0fa771ca">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:         <nova:port uuid="620aa04d-0566-4df8-8c9a-14d5c5eef099">
Nov 19 14:49:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 19 14:49:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:34 user nova-compute[74934]:       </nova:ports>
Nov 19 14:49:34 user nova-compute[74934]:     </nova:instance>
Nov 19 14:49:34 user nova-compute[74934]:   </metadata>
Nov 19 14:49:34 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:49:34 user nova-compute[74934]:     <system>
Nov 19 14:49:34 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:49:34 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:49:34 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:49:34 user nova-compute[74934]:       <entry name="serial">a5ed99bc-03bb-48f8-ab95-9c79adf3fe43</entry>
Nov 19 14:49:34 user nova-compute[74934]:       <entry name="uuid">a5ed99bc-03bb-48f8-ab95-9c79adf3fe43</entry>
Nov 19 14:49:34 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:49:34 user nova-compute[74934]:     </system>
Nov 19 14:49:34 user nova-compute[74934]:   </sysinfo>
Nov 19 14:49:34 user nova-compute[74934]:   <os>
Nov 19 14:49:34 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:49:34 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:49:34 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:49:34 user nova-compute[74934]:   </os>
Nov 19 14:49:34 user nova-compute[74934]:   <features>
Nov 19 14:49:34 user nova-compute[74934]:     <acpi/>
Nov 19 14:49:34 user nova-compute[74934]:     <apic/>
Nov 19 14:49:34 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:49:34 user nova-compute[74934]:   </features>
Nov 19 14:49:34 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:49:34 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:49:34 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:49:34 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:49:34 user nova-compute[74934]:   </clock>
Nov 19 14:49:34 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:49:34 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:49:34 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:49:34 user nova-compute[74934]:   </cpu>
Nov 19 14:49:34 user nova-compute[74934]:   <devices>
Nov 19 14:49:34 user nova-compute[74934]:     <disk type="file" device="cdrom">
Nov 19 14:49:34 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none"/>
Nov 19 14:49:34 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43/disk.config"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="hda" bus="ide"/>
Nov 19 14:49:34 user nova-compute[74934]:     </disk>
Nov 19 14:49:34 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:49:34 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:49:34 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <serial>d1bbbe24-64d5-46c7-8f55-739be2de4fe3</serial>
Nov 19 14:49:34 user nova-compute[74934]:     </disk>
Nov 19 14:49:34 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:49:34 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:49:34 user nova-compute[74934]:       <source dev="/dev/sdd"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <serial>d9019cdf-28d1-41c8-a295-dddb49bae5da</serial>
Nov 19 14:49:34 user nova-compute[74934]:     </disk>
Nov 19 14:49:34 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:49:34 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:49:34 user nova-compute[74934]:       <source dev="/dev/sdf"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="vdc" bus="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <serial>af782e66-5706-40c1-b1ef-bba5b6dfaa4a</serial>
Nov 19 14:49:34 user nova-compute[74934]:     </disk>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:2b:62:e3"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tap1a4a6bac-43"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:7f:81:b6"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tap440e714d-4e"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:3a:8c:5b"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tap31e81ef7-a1"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:e4:e1:5a"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tapa1992673-17"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:b7:02:9d"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tap4eb5b190-be"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:14:51:79"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tap02af2d15-9e"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:34 user nova-compute[74934]:       <mac address="fa:16:3e:ff:51:e7"/>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:34 user nova-compute[74934]:       <target dev="tap620aa04d-05"/>
Nov 19 14:49:34 user nova-compute[74934]:     </interface>
Nov 19 14:49:34 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:49:34 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43/console.log" append="off"/>
Nov 19 14:49:34 user nova-compute[74934]:     </serial>
Nov 19 14:49:34 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:49:34 user nova-compute[74934]:     <video>
Nov 19 14:49:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:34 user nova-compute[74934]:     </video>
Nov 19 14:49:34 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:49:34 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:49:34 user nova-compute[74934]:     </rng>
Nov 19 14:49:34 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:49:34 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:49:34 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:49:34 user nova-compute[74934]:     </memballoon>
Nov 19 14:49:34 user nova-compute[74934]:   </devices>
Nov 19 14:49:34 user nova-compute[74934]: </domain>
Nov 19 14:49:34 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2ee35f7-6f58-5d4d-b3c3-ab232ea47009', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4248b-c9ef-4ac9-ba6f-d90582c5c9f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25] added
Nov 19 14:49:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a4a6bac-43, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a4a6bac-43, col_values=(('qos', UUID('56d91eda-bbf2-4ca5-bd0a-400ed31d1e91')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a4a6bac-43, col_values=(('external_ids', {'iface-id': '1a4a6bac-437f-425d-8bd1-3703b536e668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:62:e3', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca29f4d-7e1c-48de-a57b-d03ce81e9433]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43')
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c98254d-7c5d-5cf7-ae48-a19507454c66', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019c692-0ae9-4b89-942e-73eecd6cf9c5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZXBbNPz {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap440e714d-4e, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap440e714d-4e, col_values=(('qos', UUID('a8b186e0-4664-4e9d-a70e-49ea0aa8d121')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap440e714d-4e, col_values=(('external_ids', {'iface-id': '440e714d-4e02-4421-810f-891e5769473a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:81:b6', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZXBbNPz" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d828e-6302-41c5-81e5-c40309525a0b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jZXBbNPz'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e')
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc36609-a36a-4bb4-a52e-4f32cd1f4874]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd371c2f7-0034-5236-a774-96e63cfa75ab', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aad25c8-74cf-4875-9bd0-5538fbd164f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:49:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:34 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:49:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31e81ef7-a1, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31e81ef7-a1, col_values=(('qos', UUID('273b8958-122e-4af5-87f2-7b9728a778c5')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31e81ef7-a1, col_values=(('external_ids', {'iface-id': '31e81ef7-a125-4d8a-9adc-ace52dfcc5b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:8c:5b', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1')
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34a9ca84-0a85-581a-87f4-f32fd76919d8', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db2384-e2bc-4bcd-a31a-be420af44687]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260]
Nov 19 14:49:35 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260] successful.
Nov 19 14:49:35 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1992673-17, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1992673-17, col_values=(('qos', UUID('c518be8e-c4ae-4828-88f6-a5fc3c5e947c')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1992673-17, col_values=(('external_ids', {'iface-id': 'a1992673-172b-4bcc-b293-cd0dc830f205', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:e1:5a', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f2227-3e3c-487f-b513-d3583e507f7e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17')
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c0e6645-72d4-596b-a7ce-5ace21d2d865', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab212a2-8126-4a3f-bcf8-66b672213cca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:49:35 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:49:35 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:49:35 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[263c2994-4776-44aa-8084-cbecac187b73]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZXBbNPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eb5b190-be, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4eb5b190-be, col_values=(('qos', UUID('da01d379-a741-4c7e-8690-eccbf19d161b')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4eb5b190-be, col_values=(('external_ids', {'iface-id': '4eb5b190-be80-42cf-b92b-4ac2a56cf627', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:02:9d', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be')
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd4652ee-025b-580b-b953-9b0491a3f8e4', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02af2d15-9e, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02af2d15-9e, col_values=(('qos', UUID('28ba3740-46aa-4d54-9671-8660219e2ca3')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02af2d15-9e, col_values=(('external_ids', {'iface-id': '02af2d15-9e76-438c-b4da-141a0fa771ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:51:79', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e')
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e189b3c-273b-5419-bf69-6c3c1f7b5a80', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap620aa04d-05, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap620aa04d-05, col_values=(('qos', UUID('d24ced60-826d-4fad-9fc4-50e702dbe16a')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap620aa04d-05, col_values=(('external_ids', {'iface-id': '620aa04d-0566-4df8-8c9a-14d5c5eef099', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:51:e7', 'vm-uuid': 'a5ed99bc-03bb-48f8-ab95-9c79adf3fe43'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:35 user nova-compute[74934]: INFO os_vif [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05')
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] No BDM found with device name hda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] No VIF found with MAC fa:16:3e:2b:62:e3, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] No VIF found with MAC fa:16:3e:b7:02:9d, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:49:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Using config drive
Nov 19 14:49:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Creating config drive at /opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43/disk.config
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdcxnkjt5 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdcxnkjt5" returned: 0 in 0.055s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== connect_volume: return (2664ms) {'type': 'block', 'scsi_wwn': '23265343566393832', 'path': '/dev/sdg'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265343566393832', 'path': '/dev/sdg'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ae17df3-ca5b-432a-8975-7e94b549e19e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:49:36 user nova-compute[74934]:   <uuid>0ae17df3-ca5b-432a-8975-7e94b549e19e</uuid>
Nov 19 14:49:36 user nova-compute[74934]:   <name>instance-0000000c</name>
Nov 19 14:49:36 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:49:36 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:49:36 user nova-compute[74934]:   <metadata>
Nov 19 14:49:36 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:49:36 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:49:36 user nova-compute[74934]:       <nova:name>tempest-device-tagging-server-1839427589</nova:name>
Nov 19 14:49:36 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:49:28</nova:creationTime>
Nov 19 14:49:36 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:49:36 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:49:36 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:49:36 user nova-compute[74934]:       <nova:owner>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:user uuid="66a341a079864dfca3bf3648612bc39e">tempest-TaggedBootDevicesTest-1954019468-project-member</nova:user>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:project uuid="120a65aa7a6240b48adf7b7f8c76c8a6">tempest-TaggedBootDevicesTest-1954019468</nova:project>
Nov 19 14:49:36 user nova-compute[74934]:       </nova:owner>
Nov 19 14:49:36 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:49:36 user nova-compute[74934]:       <nova:ports>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="9ded98a8-0885-42aa-9a15-9601389e55b8">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="53aee27f-edaa-4397-a44a-abe0e0df7af9">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="8585d586-26ae-480e-b6f6-a0fc57b07350">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="363ddf7b-3263-4367-9825-ea96fbc7c078">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="d3502927-a1c4-4a60-aa48-0ad21c58eaad">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:         <nova:port uuid="36df05dc-e208-4e98-a9e4-593fbf534073">
Nov 19 14:49:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 19 14:49:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:36 user nova-compute[74934]:       </nova:ports>
Nov 19 14:49:36 user nova-compute[74934]:     </nova:instance>
Nov 19 14:49:36 user nova-compute[74934]:   </metadata>
Nov 19 14:49:36 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:49:36 user nova-compute[74934]:     <system>
Nov 19 14:49:36 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:49:36 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:49:36 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:49:36 user nova-compute[74934]:       <entry name="serial">0ae17df3-ca5b-432a-8975-7e94b549e19e</entry>
Nov 19 14:49:36 user nova-compute[74934]:       <entry name="uuid">0ae17df3-ca5b-432a-8975-7e94b549e19e</entry>
Nov 19 14:49:36 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:49:36 user nova-compute[74934]:     </system>
Nov 19 14:49:36 user nova-compute[74934]:   </sysinfo>
Nov 19 14:49:36 user nova-compute[74934]:   <os>
Nov 19 14:49:36 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:49:36 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:49:36 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:49:36 user nova-compute[74934]:   </os>
Nov 19 14:49:36 user nova-compute[74934]:   <features>
Nov 19 14:49:36 user nova-compute[74934]:     <acpi/>
Nov 19 14:49:36 user nova-compute[74934]:     <apic/>
Nov 19 14:49:36 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:49:36 user nova-compute[74934]:   </features>
Nov 19 14:49:36 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:49:36 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:49:36 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:49:36 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:49:36 user nova-compute[74934]:   </clock>
Nov 19 14:49:36 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:49:36 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:49:36 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:49:36 user nova-compute[74934]:   </cpu>
Nov 19 14:49:36 user nova-compute[74934]:   <devices>
Nov 19 14:49:36 user nova-compute[74934]:     <disk type="file" device="cdrom">
Nov 19 14:49:36 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none"/>
Nov 19 14:49:36 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e/disk.config"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="hda" bus="ide"/>
Nov 19 14:49:36 user nova-compute[74934]:     </disk>
Nov 19 14:49:36 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:49:36 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:49:36 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <serial>33f1fce9-2d60-42ff-80e8-fd18c7bc03eb</serial>
Nov 19 14:49:36 user nova-compute[74934]:     </disk>
Nov 19 14:49:36 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:49:36 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:49:36 user nova-compute[74934]:       <source dev="/dev/sde"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <serial>4098aa71-7717-4be5-bbb9-597216910dce</serial>
Nov 19 14:49:36 user nova-compute[74934]:     </disk>
Nov 19 14:49:36 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:49:36 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:49:36 user nova-compute[74934]:       <source dev="/dev/sdg"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="vdc" bus="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <serial>9ade7d41-4451-4074-b7f1-475bdc22dc25</serial>
Nov 19 14:49:36 user nova-compute[74934]:     </disk>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:23:de:ee"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tap9ded98a8-08"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:9f:93:6f"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tap53aee27f-ed"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:a7:e0:ef"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tap8585d586-26"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:23:98:5e"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tapaeba2c8d-b7"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:37:37:ed"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tap363ddf7b-32"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:24:80:8b"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tapd3502927-a1"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:36 user nova-compute[74934]:       <mac address="fa:16:3e:ca:2f:b0"/>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:36 user nova-compute[74934]:       <target dev="tap36df05dc-e2"/>
Nov 19 14:49:36 user nova-compute[74934]:     </interface>
Nov 19 14:49:36 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:49:36 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e/console.log" append="off"/>
Nov 19 14:49:36 user nova-compute[74934]:     </serial>
Nov 19 14:49:36 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:49:36 user nova-compute[74934]:     <video>
Nov 19 14:49:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:36 user nova-compute[74934]:     </video>
Nov 19 14:49:36 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:49:36 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:49:36 user nova-compute[74934]:     </rng>
Nov 19 14:49:36 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:49:36 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:49:36 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:49:36 user nova-compute[74934]:     </memballoon>
Nov 19 14:49:36 user nova-compute[74934]:   </devices>
Nov 19 14:49:36 user nova-compute[74934]: </domain>
Nov 19 14:49:36 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b89c4718-679e-5c31-80c6-a0b4a0cf1489', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ded98a8-08, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ded98a8-08, col_values=(('qos', UUID('95ce5e77-cc5f-4056-9e44-64b00ac7d989')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ded98a8-08, col_values=(('external_ids', {'iface-id': '9ded98a8-0885-42aa-9a15-9601389e55b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:de:ee', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08')
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd18cea3a-54b7-58be-8a05-41122d8a1876', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53aee27f-ed, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53aee27f-ed, col_values=(('qos', UUID('39a389be-93cd-4968-8347-d3f109762466')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53aee27f-ed, col_values=(('external_ids', {'iface-id': '53aee27f-edaa-4397-a44a-abe0e0df7af9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:93:6f', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed')
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80fac71f-a2e2-5d1a-8f35-f2b4a53ab95a', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8585d586-26, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8585d586-26, col_values=(('qos', UUID('ebe1a091-fa73-48ce-a96b-e3079ab422d5')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8585d586-26, col_values=(('external_ids', {'iface-id': '8585d586-26ae-480e-b6f6-a0fc57b07350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:e0:ef', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26')
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb15e463-fc79-5672-854a-7de7f46af3aa', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaeba2c8d-b7, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaeba2c8d-b7, col_values=(('qos', UUID('6980881e-6176-4958-989f-ec1ac8131c56')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaeba2c8d-b7, col_values=(('external_ids', {'iface-id': 'aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:98:5e', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7')
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7841df7-4304-5ffa-84f5-a026bc3c6871', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap363ddf7b-32, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap363ddf7b-32, col_values=(('qos', UUID('c85bd0c1-7cab-4300-a357-cd89c1cb0b30')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap363ddf7b-32, col_values=(('external_ids', {'iface-id': '363ddf7b-3263-4367-9825-ea96fbc7c078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:37:ed', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32')
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70e6fe35-dffc-5dc9-bc3c-18364738add3', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3502927-a1, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3502927-a1, col_values=(('qos', UUID('64e8dfb8-8330-4b7d-9757-800dba1ee274')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3502927-a1, col_values=(('external_ids', {'iface-id': 'd3502927-a1c4-4a60-aa48-0ad21c58eaad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:80:8b', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1')
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8be1da1-b9a0-56cd-9133-21b4ea2afbec', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36df05dc-e2, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36df05dc-e2, col_values=(('qos', UUID('ea1a52d3-f5c9-4603-ad06-ba1399ba095a')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36df05dc-e2, col_values=(('external_ids', {'iface-id': '36df05dc-e208-4e98-a9e4-593fbf534073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:2f:b0', 'vm-uuid': '0ae17df3-ca5b-432a-8975-7e94b549e19e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:37 user nova-compute[74934]: INFO os_vif [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2')
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] No BDM found with device name hda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] No VIF found with MAC fa:16:3e:23:de:ee, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] No VIF found with MAC fa:16:3e:37:37:ed, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:49:37 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Using config drive
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-c0fc5c47-b85c-4e23-99d9-c22ae4d5a5e2 req-20823f59-091b-4126-8dc8-8450e3815ca0 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c0fc5c47-b85c-4e23-99d9-c22ae4d5a5e2 req-20823f59-091b-4126-8dc8-8450e3815ca0 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c0fc5c47-b85c-4e23-99d9-c22ae4d5a5e2 req-20823f59-091b-4126-8dc8-8450e3815ca0 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c0fc5c47-b85c-4e23-99d9-c22ae4d5a5e2 req-20823f59-091b-4126-8dc8-8450e3815ca0 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-c0fc5c47-b85c-4e23-99d9-c22ae4d5a5e2 req-20823f59-091b-4126-8dc8-8450e3815ca0 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:37 user nova-compute[74934]: WARNING nova.compute.manager [req-c0fc5c47-b85c-4e23-99d9-c22ae4d5a5e2 req-20823f59-091b-4126-8dc8-8450e3815ca0 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with vm_state building and task_state spawning.
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Creating config drive at /opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e/disk.config
Nov 19 14:49:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0h3uui9s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0h3uui9s" returned: 0 in 0.055s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-7937908c-af5d-485c-ac48-80d965ba565c req-6c1e02a9-94da-4916-8082-3fc635538a4b service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7937908c-af5d-485c-ac48-80d965ba565c req-6c1e02a9-94da-4916-8082-3fc635538a4b service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7937908c-af5d-485c-ac48-80d965ba565c req-6c1e02a9-94da-4916-8082-3fc635538a4b service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7937908c-af5d-485c-ac48-80d965ba565c req-6c1e02a9-94da-4916-8082-3fc635538a4b service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-7937908c-af5d-485c-ac48-80d965ba565c req-6c1e02a9-94da-4916-8082-3fc635538a4b service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:38 user nova-compute[74934]: WARNING nova.compute.manager [req-7937908c-af5d-485c-ac48-80d965ba565c req-6c1e02a9-94da-4916-8082-3fc635538a4b service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a for instance with vm_state building and task_state spawning.
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:39 user nova-compute[74934]: WARNING nova.compute.manager [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with vm_state building and task_state spawning.
Nov 19 14:49:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:39 user nova-compute[74934]: WARNING nova.compute.manager [req-31cf7f98-28ff-4b4e-8278-2c67ae887b0c req-7e549d12-8b01-44cb-ac69-61e8479f39e5 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:40 user nova-compute[74934]: WARNING nova.compute.manager [req-aa861d0e-a240-4be5-8c76-56564e2e0958 req-3cb8fc50-4228-457a-b9ef-a01920cb871c service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca for instance with vm_state building and task_state spawning.
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-7babf546-1458-438d-a6b0-ac93799cbe75 req-74cae732-c233-4139-a7e2-d8c70b8d4bfe service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7babf546-1458-438d-a6b0-ac93799cbe75 req-74cae732-c233-4139-a7e2-d8c70b8d4bfe service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7babf546-1458-438d-a6b0-ac93799cbe75 req-74cae732-c233-4139-a7e2-d8c70b8d4bfe service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7babf546-1458-438d-a6b0-ac93799cbe75 req-74cae732-c233-4139-a7e2-d8c70b8d4bfe service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-7babf546-1458-438d-a6b0-ac93799cbe75 req-74cae732-c233-4139-a7e2-d8c70b8d4bfe service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:41 user nova-compute[74934]: WARNING nova.compute.manager [req-7babf546-1458-438d-a6b0-ac93799cbe75 req-74cae732-c233-4139-a7e2-d8c70b8d4bfe service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 for instance with vm_state building and task_state spawning.
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-4535eaeb-bcf2-485a-a3b9-3e8b5a42b7cb req-bfdc7a96-97b4-4b7f-aeb2-7246a92937f4 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:42 user nova-compute[74934]: WARNING nova.compute.manager [req-37f094d7-129a-4273-8bc0-69a717e402b3 req-f53c0162-f826-4a11-a5b6-555a053a8ed1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 for instance with vm_state building and task_state spawning.
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:43 user nova-compute[74934]: WARNING nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 for instance with vm_state building and task_state spawning.
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:43 user nova-compute[74934]: WARNING nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 for instance with vm_state building and task_state spawning.
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:43 user nova-compute[74934]: WARNING nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 for instance with vm_state building and task_state spawning.
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:43 user nova-compute[74934]: WARNING nova.compute.manager [req-4cbf7128-1156-4ce3-8803-fba1b7fba381 req-ba6e9385-a80e-4994-ae81-2b0815304955 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad for instance with vm_state building and task_state spawning.
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:44 user nova-compute[74934]: WARNING nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 for instance with vm_state building and task_state spawning.
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:44 user nova-compute[74934]: WARNING nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 for instance with vm_state building and task_state spawning.
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:44 user nova-compute[74934]: WARNING nova.compute.manager [req-c3558ebc-06c9-412d-a5f0-c07e33f5244f req-bcb49db7-71e5-4c4e-b87c-b7b10e77f3ec service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 for instance with vm_state building and task_state spawning.
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:49:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance spawned successfully.
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:44 user nova-compute[74934]: INFO nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Took 16.69 seconds to spawn the instance on the hypervisor.
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-a58c9e44-96ef-4fd0-8b34-f0f11245e6b1 req-415ea680-8aad-4351-b714-c330df5dfed9 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a58c9e44-96ef-4fd0-8b34-f0f11245e6b1 req-415ea680-8aad-4351-b714-c330df5dfed9 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a58c9e44-96ef-4fd0-8b34-f0f11245e6b1 req-415ea680-8aad-4351-b714-c330df5dfed9 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a58c9e44-96ef-4fd0-8b34-f0f11245e6b1 req-415ea680-8aad-4351-b714-c330df5dfed9 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-a58c9e44-96ef-4fd0-8b34-f0f11245e6b1 req-415ea680-8aad-4351-b714-c330df5dfed9 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:44 user nova-compute[74934]: WARNING nova.compute.manager [req-a58c9e44-96ef-4fd0-8b34-f0f11245e6b1 req-415ea680-8aad-4351-b714-c330df5dfed9 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 for instance with vm_state building and task_state spawning.
Nov 19 14:49:44 user nova-compute[74934]: INFO nova.compute.manager [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Took 37.38 seconds to build instance.
Nov 19 14:49:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f8fc86d-601f-466a-b3e9-1e0a1ed44511 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.527s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-115b4954-d42c-4b4b-a8e7-f62ac0ee0470 req-436e6582-08b0-442e-b507-49996aaa65e1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-115b4954-d42c-4b4b-a8e7-f62ac0ee0470 req-436e6582-08b0-442e-b507-49996aaa65e1 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-115b4954-d42c-4b4b-a8e7-f62ac0ee0470 req-436e6582-08b0-442e-b507-49996aaa65e1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-115b4954-d42c-4b4b-a8e7-f62ac0ee0470 req-436e6582-08b0-442e-b507-49996aaa65e1 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-115b4954-d42c-4b4b-a8e7-f62ac0ee0470 req-436e6582-08b0-442e-b507-49996aaa65e1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:45 user nova-compute[74934]: WARNING nova.compute.manager [req-115b4954-d42c-4b4b-a8e7-f62ac0ee0470 req-436e6582-08b0-442e-b507-49996aaa65e1 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad for instance with vm_state building and task_state spawning.
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:49:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance spawned successfully.
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:49:45 user nova-compute[74934]: INFO nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Took 17.00 seconds to spawn the instance on the hypervisor.
Nov 19 14:49:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:49:45 user nova-compute[74934]: INFO nova.compute.manager [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Took 38.65 seconds to build instance.
Nov 19 14:49:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a76c50b9-1c50-4de6-a2ee-c5d096cda683 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.762s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:48 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:49 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-changed-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Refreshing instance network info cache due to event network-changed-bd3c8114-6b3f-4adf-820a-42f5197fc7b4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Refreshing network info cache for port bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updated VIF entry in instance network info cache for port bd3c8114-6b3f-4adf-820a-42f5197fc7b4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef039ebb-c7b2-4db4-bf27-12d57930f6f6 req-8f7087dd-7633-4523-9173-1d19d26aabc4 service nova] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: INFO nova.compute.manager [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] instance snapshotting
Nov 19 14:49:53 user nova-compute[74934]: INFO nova.compute.manager [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Rescuing
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG nova.network.neutron [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:49:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Beginning live snapshot process
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG nova.network.neutron [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-095cf01c-5345-4c35-bdc2-a601e91f97c8 req-895f5bea-52fc-4585-b40e-53dffb332554 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-unplugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-095cf01c-5345-4c35-bdc2-a601e91f97c8 req-895f5bea-52fc-4585-b40e-53dffb332554 service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-095cf01c-5345-4c35-bdc2-a601e91f97c8 req-895f5bea-52fc-4585-b40e-53dffb332554 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-095cf01c-5345-4c35-bdc2-a601e91f97c8 req-895f5bea-52fc-4585-b40e-53dffb332554 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-095cf01c-5345-4c35-bdc2-a601e91f97c8 req-895f5bea-52fc-4585-b40e-53dffb332554 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-unplugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:54 user nova-compute[74934]: WARNING nova.compute.manager [req-095cf01c-5345-4c35-bdc2-a601e91f97c8 req-895f5bea-52fc-4585-b40e-53dffb332554 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-unplugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state active and task_state rescuing.
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp93sfkkqy/8f2a2ae830294733a652efb974234c9e.delta 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp93sfkkqy/8f2a2ae830294733a652efb974234c9e.delta 1073741824" returned: 0 in 0.049s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 19 14:49:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74934) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 19 14:49:54 user nova-compute[74934]: INFO nova.virt.libvirt.host [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] UEFI support detected
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] COPY block job progress, current cursor: 15204352 final cursor: 75497472 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:49:55 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:55 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6665MB free_disk=25.472492218017578GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance destroyed successfully.
Nov 19 14:49:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Attempting rescue
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74934) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 14:49:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Creating image(s)
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.068s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 8b33af6a-67df-485c-84d9-ce224f78e67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b7614315-a839-4dbf-8137-9b4a096bea5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60dddb96-ee81-4cc8-8960-7e0189d4543b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 2764ee50-8167-4303-af46-c15e6e354f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0ae17df3-ca5b-432a-8975-7e94b549e19e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance a5ed99bc-03bb-48f8-ab95-9c79adf3fe43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue" returned: 0 in 0.054s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'migration_context' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<73f74149-9044-4fd3-b73a-5082a7b0fd86> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Start _get_guest_xml network_info=[{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:70:f9:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'resources' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<73f74149-9044-4fd3-b73a-5082a7b0fd86> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'numa_topology' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<73f74149-9044-4fd3-b73a-5082a7b0fd86> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:49:55 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:55 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<73f74149-9044-4fd3-b73a-5082a7b0fd86> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998578892',display_name='tempest-ServerRescueNegativeTestJSON-server-998578892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998578892',id=3,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-kp4hnesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:20Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=73f74149-9044-4fd3-b73a-5082a7b0fd86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:70:f9:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:70:f9:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'pci_devices' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:49:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<73f74149-9044-4fd3-b73a-5082a7b0fd86> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:49:55 user nova-compute[74934]:   <uuid>73f74149-9044-4fd3-b73a-5082a7b0fd86</uuid>
Nov 19 14:49:55 user nova-compute[74934]:   <name>instance-00000003</name>
Nov 19 14:49:55 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:49:55 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:49:55 user nova-compute[74934]:   <metadata>
Nov 19 14:49:55 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:49:55 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:49:55 user nova-compute[74934]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-998578892</nova:name>
Nov 19 14:49:55 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:49:55</nova:creationTime>
Nov 19 14:49:55 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:49:55 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:49:55 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:49:55 user nova-compute[74934]:       <nova:owner>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:user uuid="cdbd678512a7438bac9bc337a0d94ecf">tempest-ServerRescueNegativeTestJSON-1330458851-project-member</nova:user>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:project uuid="0de5bebd7613411cb782d31ed1884da8">tempest-ServerRescueNegativeTestJSON-1330458851</nova:project>
Nov 19 14:49:55 user nova-compute[74934]:       </nova:owner>
Nov 19 14:49:55 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:49:55 user nova-compute[74934]:       <nova:ports>
Nov 19 14:49:55 user nova-compute[74934]:         <nova:port uuid="38fdb168-5074-4b4f-9495-8986af433ea9">
Nov 19 14:49:55 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 19 14:49:55 user nova-compute[74934]:         </nova:port>
Nov 19 14:49:55 user nova-compute[74934]:       </nova:ports>
Nov 19 14:49:55 user nova-compute[74934]:     </nova:instance>
Nov 19 14:49:55 user nova-compute[74934]:   </metadata>
Nov 19 14:49:55 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:49:55 user nova-compute[74934]:     <system>
Nov 19 14:49:55 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:49:55 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:49:55 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:49:55 user nova-compute[74934]:       <entry name="serial">73f74149-9044-4fd3-b73a-5082a7b0fd86</entry>
Nov 19 14:49:55 user nova-compute[74934]:       <entry name="uuid">73f74149-9044-4fd3-b73a-5082a7b0fd86</entry>
Nov 19 14:49:55 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:49:55 user nova-compute[74934]:     </system>
Nov 19 14:49:55 user nova-compute[74934]:   </sysinfo>
Nov 19 14:49:55 user nova-compute[74934]:   <os>
Nov 19 14:49:55 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:49:55 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:49:55 user nova-compute[74934]:   </os>
Nov 19 14:49:55 user nova-compute[74934]:   <features>
Nov 19 14:49:55 user nova-compute[74934]:     <acpi/>
Nov 19 14:49:55 user nova-compute[74934]:     <apic/>
Nov 19 14:49:55 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:49:55 user nova-compute[74934]:   </features>
Nov 19 14:49:55 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:49:55 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:49:55 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:49:55 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:49:55 user nova-compute[74934]:   </clock>
Nov 19 14:49:55 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:49:55 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:49:55 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:49:55 user nova-compute[74934]:   </cpu>
Nov 19 14:49:55 user nova-compute[74934]:   <devices>
Nov 19 14:49:55 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:49:55 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:49:55 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue"/>
Nov 19 14:49:55 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:49:55 user nova-compute[74934]:     </disk>
Nov 19 14:49:55 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:49:55 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:49:55 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk"/>
Nov 19 14:49:55 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:49:55 user nova-compute[74934]:     </disk>
Nov 19 14:49:55 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:49:55 user nova-compute[74934]:       <mac address="fa:16:3e:70:f9:87"/>
Nov 19 14:49:55 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:55 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:49:55 user nova-compute[74934]:       <target dev="tap38fdb168-50"/>
Nov 19 14:49:55 user nova-compute[74934]:     </interface>
Nov 19 14:49:55 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:49:55 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/console.log" append="off"/>
Nov 19 14:49:55 user nova-compute[74934]:     </serial>
Nov 19 14:49:55 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:49:55 user nova-compute[74934]:     <video>
Nov 19 14:49:55 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:49:55 user nova-compute[74934]:     </video>
Nov 19 14:49:55 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:49:55 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:49:55 user nova-compute[74934]:     </rng>
Nov 19 14:49:55 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:49:55 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:49:55 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:49:55 user nova-compute[74934]:     </memballoon>
Nov 19 14:49:55 user nova-compute[74934]:   </devices>
Nov 19 14:49:55 user nova-compute[74934]: </domain>
Nov 19 14:49:55 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:49:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance destroyed successfully.
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:70:f9:87, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:49:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp93sfkkqy/8f2a2ae830294733a652efb974234c9e.delta /opt/stack/data/nova/instances/snapshots/tmp93sfkkqy/8f2a2ae830294733a652efb974234c9e {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG nova.compute.manager [req-b6a28b37-33ad-46d5-962c-1a572d7bb616 req-b6ee3bd0-6e13-462a-8857-7e42568b0c25 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b6a28b37-33ad-46d5-962c-1a572d7bb616 req-b6ee3bd0-6e13-462a-8857-7e42568b0c25 service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b6a28b37-33ad-46d5-962c-1a572d7bb616 req-b6ee3bd0-6e13-462a-8857-7e42568b0c25 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b6a28b37-33ad-46d5-962c-1a572d7bb616 req-b6ee3bd0-6e13-462a-8857-7e42568b0c25 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG nova.compute.manager [req-b6a28b37-33ad-46d5-962c-1a572d7bb616 req-b6ee3bd0-6e13-462a-8857-7e42568b0c25 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:56 user nova-compute[74934]: WARNING nova.compute.manager [req-b6a28b37-33ad-46d5-962c-1a572d7bb616 req-b6ee3bd0-6e13-462a-8857-7e42568b0c25 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state active and task_state rescuing.
Nov 19 14:49:56 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp93sfkkqy/8f2a2ae830294733a652efb974234c9e.delta /opt/stack/data/nova/instances/snapshots/tmp93sfkkqy/8f2a2ae830294733a652efb974234c9e" returned: 0 in 0.312s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:49:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Snapshot extracted, beginning image upload
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:56 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:58 user nova-compute[74934]: WARNING nova.compute.manager [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state active and task_state rescuing.
Nov 19 14:49:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:49:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:49:58 user nova-compute[74934]: WARNING nova.compute.manager [req-14c90c50-4dd4-4b14-aafd-fe35bcfd5de3 req-ea019159-b0b9-45cf-a5dd-bdcc5ad8b3fc service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state active and task_state rescuing.
Nov 19 14:49:58 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Snapshot image upload complete
Nov 19 14:49:58 user nova-compute[74934]: INFO nova.compute.manager [None req-6b028aa2-cd1d-4db1-8e1c-9d0fd08287c8 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Took 5.73 seconds to snapshot the instance on the hypervisor.
Nov 19 14:49:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:49:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-101f5f0b-1a51-439f-ab2e-d7b4859b1bcb tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing instance network info cache due to event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updated VIF entry in instance network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d8b0f643-acc5-4356-9aa6-9ebde7742bae req-adeda359-dffc-41a2-9cc3-d509f3444154 service nova] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:06 user nova-compute[74934]: INFO nova.compute.manager [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Shelving
Nov 19 14:50:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-51bc39d7-2cfc-4937-b65b-5300c9a3a31c req-0b1d7ac3-9df8-4b0e-aa89-23e36c2c73cb service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51bc39d7-2cfc-4937-b65b-5300c9a3a31c req-0b1d7ac3-9df8-4b0e-aa89-23e36c2c73cb service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51bc39d7-2cfc-4937-b65b-5300c9a3a31c req-0b1d7ac3-9df8-4b0e-aa89-23e36c2c73cb service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51bc39d7-2cfc-4937-b65b-5300c9a3a31c req-0b1d7ac3-9df8-4b0e-aa89-23e36c2c73cb service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-51bc39d7-2cfc-4937-b65b-5300c9a3a31c req-0b1d7ac3-9df8-4b0e-aa89-23e36c2c73cb service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:06 user nova-compute[74934]: WARNING nova.compute.manager [req-51bc39d7-2cfc-4937-b65b-5300c9a3a31c req-0b1d7ac3-9df8-4b0e-aa89-23e36c2c73cb service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state active and task_state shelving.
Nov 19 14:50:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance destroyed successfully.
Nov 19 14:50:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Beginning cold snapshot process
Nov 19 14:50:07 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:50:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk /opt/stack/data/nova/instances/snapshots/tmpy0giwarm/08c2071f55684aa79959dc9c557dde5d {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk /opt/stack/data/nova/instances/snapshots/tmpy0giwarm/08c2071f55684aa79959dc9c557dde5d" returned: 0 in 0.541s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Snapshot extracted, beginning image upload
Nov 19 14:50:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-1d04be36-5c8e-413b-93e2-d0717ea48c3b req-3315baf6-ac2b-4371-bbac-3ed5b284df52 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1d04be36-5c8e-413b-93e2-d0717ea48c3b req-3315baf6-ac2b-4371-bbac-3ed5b284df52 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1d04be36-5c8e-413b-93e2-d0717ea48c3b req-3315baf6-ac2b-4371-bbac-3ed5b284df52 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1d04be36-5c8e-413b-93e2-d0717ea48c3b req-3315baf6-ac2b-4371-bbac-3ed5b284df52 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-1d04be36-5c8e-413b-93e2-d0717ea48c3b req-3315baf6-ac2b-4371-bbac-3ed5b284df52 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:08 user nova-compute[74934]: WARNING nova.compute.manager [req-1d04be36-5c8e-413b-93e2-d0717ea48c3b req-3315baf6-ac2b-4371-bbac-3ed5b284df52 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state active and task_state shelving_image_uploading.
Nov 19 14:50:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Snapshot image upload complete
Nov 19 14:50:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:50:10 user nova-compute[74934]: INFO nova.compute.manager [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Shelve offloading
Nov 19 14:50:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance destroyed successfully.
Nov 19 14:50:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:50:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:50:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance destroyed successfully.
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'resources' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825075697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825075697',id=5,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Y3h6aLjtCzoN+E+lUu1qIcE4QgeNEU2ikSyYhYWuvHg1BlmCQoBaFq86cdChZJUHwzciS4tr2s3Iu1W4lv2rIx8WLnP+FzMdefFfivNjQZMFhpRRsM0GJW1zVwz3eqg==',key_name='tempest-keypair-1600849378',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-qq0f56qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member',shelved_at='2023-11-19T14:50:10.301262',shelved_host='user',shelved_image_id='f9c4daa1-1512-4d63-93bc-ad0dc89189ce'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=4eb838ad-d995-407b-ab5a-b8dc8df9a60e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG os_vif [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cd621cf-48, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing instance network info cache due to event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=224d9610-c11f-4892-bf9c-7f14e6748223) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:11 user nova-compute[74934]: INFO os_vif [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48')
Nov 19 14:50:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Deleting instance files /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e_del
Nov 19 14:50:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Deletion of /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e_del complete
Nov 19 14:50:11 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Deleted allocations for instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e
Nov 19 14:50:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'numa_topology' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.objects.base [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<4eb838ad-d995-407b-ab5a-b8dc8df9a60e> lazy-loaded attributes: resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updated VIF entry in instance network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0cd621cf-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-98683024-8dd5-429d-914a-88ff8c374a0d req-82cdce16-002d-4296-bf74-0a78379376a5 service nova] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:50:11 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:50:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13f91d24-3cb4-4212-b338-7176a735273e tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.786s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-changed-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Refreshing instance network info cache due to event network-changed-4cc72428-c39e-4bb5-8c34-f64c3b294e95. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] Acquiring lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] Acquired lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Refreshing network info cache for port 4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:16 user nova-compute[74934]: DEBUG nova.network.neutron [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updated VIF entry in instance network info cache for port 4cc72428-c39e-4bb5-8c34-f64c3b294e95. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:16 user nova-compute[74934]: DEBUG nova.network.neutron [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updating instance_info_cache with network_info: [{"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b2f1bdcb-63d5-4eb1-b9f6-c86aac2651ba req-c5753b6c-69e9-426c-a075-6ff5d2cbf16e service nova] Releasing lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-changed-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Refreshing instance network info cache due to event network-changed-e29f0db5-7542-47c0-a806-709a6982344e. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] Acquiring lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] Acquired lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Refreshing network info cache for port e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updated VIF entry in instance network info cache for port e29f0db5-7542-47c0-a806-709a6982344e. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updating instance_info_cache with network_info: [{"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e285abf3-04d8-4fcb-b2c2-dfbaafbb2c97 req-5d48f29f-0f3a-4269-bbe2-f66e5f590429 service nova] Releasing lock "refresh_cache-2e319dfa-bb7c-461a-a408-c8f7edf6c221" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'flavor' on Instance uuid 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:18 user nova-compute[74934]: INFO nova.compute.manager [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Attaching volume 9e924d19-7a0c-4b71-92c2-b28fbb6781b1 to /dev/vdb
Nov 19 14:50:18 user nova-compute[74934]: DEBUG os_brick.utils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f4012-f61f-4dcf-ad66-967452d929e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14ec52c-5c17-4660-bcfe-202c9c550522]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad9d6ca-0a63-4893-84df-ef60030cb5ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c095e9-e158-44a9-824a-df6f597ef383]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:18 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[85676548-042c-4424-9da5-e86ab7097999]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG os_brick.utils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:18 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updating existing volume attachment record: 150aaa98-4f6d-47ac-b798-ff4c25f0fe03 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lazy-loading 'flavor' on Instance uuid 2e319dfa-bb7c-461a-a408-c8f7edf6c221 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:19 user nova-compute[74934]: INFO nova.compute.manager [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Attaching volume f63df33b-6083-4c4b-aa82-5b44adb27f22 to /dev/sdc
Nov 19 14:50:19 user nova-compute[74934]: DEBUG os_brick.utils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e30e981-4876-4be2-9a8b-89ac34aa14fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d92d47a-9906-4f89-8bac-cc5fed5c408e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[841fcffc-3ac2-4b6f-a4c7-a5e10788b8e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de35942-8f96-4462-99f6-12d674f6d656]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:19 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba02cfa-59d5-4a5a-92f4-c2314eb751f5]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG os_brick.utils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:19 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updating existing volume attachment record: a41e39c6-a7ac-4f27-b9f6-a5808e25b262 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:50:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzQnVUml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:24 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:24 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:24 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d4d36-9dad-4ea7-99ae-700b42c42c00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:24 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efdf1c-1e4c-43f3-a82c-eb1efd1d4789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1] added
Nov 19 14:50:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[722d59ca-d2ba-4f18-93a2-fbe8558decdd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778bd9c-5eca-4e04-a7b8-5ef9e99a889a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzQnVUml {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pzQnVUml" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd8a79-7d61-43eb-8965-4f3c3609913f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pzQnVUml'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea5671-c892-43fa-ae70-a6ac9a90a1c8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fecf4ff-94c0-4b12-87c8-8f774b106c5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebae7c1-5e5d-45b8-ba7c-c8b947bc31ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260]
Nov 19 14:50:24 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5fa34-5e0f-4262-9f69-d39fe45b763f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d96a44-7e58-4dad-b6ba-2a412ce25afe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63cf476-6a86-4bd3-9a89-30630c2782f6]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzQnVUml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-changed-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Refreshing instance network info cache due to event network-changed-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] Acquiring lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] Acquired lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Refreshing network info cache for port 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updated VIF entry in instance network info cache for port 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeEDbdZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:25 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "interface-b7614315-a839-4dbf-8137-9b4a096bea5b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "interface-b7614315-a839-4dbf-8137-9b4a096bea5b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'flavor' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1b64f270-7908-43e0-8fea-ceb7a6bfa9b0 req-e9d36fd3-1770-4b5d-944e-0f01a25a47d7 service nova] Releasing lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'pci_requests' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.objects.base [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Object Instance<b7614315-a839-4dbf-8137-9b4a096bea5b> lazy-loaded attributes: flavor,pci_requests {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.policy [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5575961a25d9487ab557835abe15c460', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5463253de6814508960ba3cd7514bb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23136386139303264', 'path': '/dev/sdh'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136386139303264', 'path': '/dev/sdh'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.354s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:25 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:25 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'flavor' on Instance uuid 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2061c13-fea0-4f6f-9c65-b9255e67e536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:25 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:50:25 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:25 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 14:50:25 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:25 user nova-compute[74934]:   <serial>9e924d19-7a0c-4b71-92c2-b28fbb6781b1</serial>
Nov 19 14:50:25 user nova-compute[74934]: </disk>
Nov 19 14:50:25 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[13582567-e83d-42cf-8c60-8b12f116c112]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22] added
Nov 19 14:50:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67aa1be-4f1e-4717-8552-b26f16af9ea5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cd58eb-5283-46f5-a976-189117de4141]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OeEDbdZx {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OeEDbdZx" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a99aa8-8a9a-4fd2-a09a-53247e3a49d7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OeEDbdZx'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[754674ad-fb8a-4a00-85b1-37831b38ae4e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d532f2-b3a1-4db5-ac9b-f3dc3ef25745]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:25 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7161fb6-b7b4-49a4-8bdc-0a70c74b35e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260]
Nov 19 14:50:26 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa1f1d-f9ad-4ec2-b857-6d15f25524fe]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f4e39-9b99-49c4-bec0-4e9aace11a6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9e324-10c5-439c-a256-dc41ebf1774a]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeEDbdZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Successfully created port: a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No VIF found with MAC fa:16:3e:97:c7:cb, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad27146b-2478-400e-a1d2-a6f77fa066ce tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.857s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Successfully updated port: a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquired lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-changed-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Refreshing instance network info cache due to event network-changed-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] Acquiring lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] <== connect_volume: return (1725ms) {'type': 'block', 'scsi_wwn': '26237383964633965', 'path': '/dev/sdi'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383964633965', 'path': '/dev/sdi'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lazy-loading 'flavor' on Instance uuid 2e319dfa-bb7c-461a-a408-c8f7edf6c221 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:50:27 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:27 user nova-compute[74934]:   <source dev="/dev/sdi"/>
Nov 19 14:50:27 user nova-compute[74934]:   <target dev="sdc" bus="scsi"/>
Nov 19 14:50:27 user nova-compute[74934]:   <serial>f63df33b-6083-4c4b-aa82-5b44adb27f22</serial>
Nov 19 14:50:27 user nova-compute[74934]:   <address type="drive" controller="0" unit="2"/>
Nov 19 14:50:27 user nova-compute[74934]: </disk>
Nov 19 14:50:27 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Releasing lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] Acquired lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Refreshing network info cache for port a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG os_vif [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0d440c6-7955-574c-a7aa-590d369cc3c9', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4c5c9bb-69, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4c5c9bb-69, col_values=(('qos', UUID('4d731f57-d83f-46ef-bf3a-a6c944ae33e3')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4c5c9bb-69, col_values=(('external_ids', {'iface-id': 'a4c5c9bb-69dc-4333-ae96-ae4bfe37f839', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:05:4d', 'vm-uuid': 'b7614315-a839-4dbf-8137-9b4a096bea5b'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: INFO os_vif [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69')
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] attach device xml: <interface type="ethernet">
Nov 19 14:50:27 user nova-compute[74934]:   <mac address="fa:16:3e:5e:05:4d"/>
Nov 19 14:50:27 user nova-compute[74934]:   <model type="virtio"/>
Nov 19 14:50:27 user nova-compute[74934]:   <mtu size="1442"/>
Nov 19 14:50:27 user nova-compute[74934]:   <target dev="tapa4c5c9bb-69"/>
Nov 19 14:50:27 user nova-compute[74934]: </interface>
Nov 19 14:50:27 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-changed-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Refreshing instance network info cache due to event network-changed-717622fa-a1ff-4988-9e16-f399ba8f9020. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] Acquiring lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] Acquired lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.network.neutron [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Refreshing network info cache for port 717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No BDM found with device name sda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] No VIF found with MAC fa:16:3e:8f:e0:bb, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:27 user nova-compute[74934]: INFO nova.compute.manager [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Detaching volume 9e924d19-7a0c-4b71-92c2-b28fbb6781b1
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9a48a5c8-6daa-4f5e-b659-4a70e462d8c9 tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.641s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lazy-loading 'flavor' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:28 user nova-compute[74934]: INFO nova.virt.block_device [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Attempting to driver detach volume 9e924d19-7a0c-4b71-92c2-b28fbb6781b1 from mountpoint /dev/vdb
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updated VIF entry in instance network info cache for port a4c5c9bb-69dc-4333-ae96-ae4bfe37f839. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d8a73d2-4c6b-456c-a8de-beeedebba4af req-cbbb02f5-a114-40f3-bffa-4f9e61671b61 service nova] Releasing lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No BDM found with device name hda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No VIF found with MAC fa:16:3e:7d:a1:30, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Attempting to detach device vdb from instance 8b33af6a-67df-485c-84d9-ce224f78e67c from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:28 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:28 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 14:50:28 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:28 user nova-compute[74934]:   <serial>9e924d19-7a0c-4b71-92c2-b28fbb6781b1</serial>
Nov 19 14:50:28 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:50:28 user nova-compute[74934]: </disk>
Nov 19 14:50:28 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Successfully detached device vdb from instance 8b33af6a-67df-485c-84d9-ce224f78e67c from the persistent domain config.
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b33af6a-67df-485c-84d9-ce224f78e67c from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:28 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:28 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 14:50:28 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:28 user nova-compute[74934]:   <serial>9e924d19-7a0c-4b71-92c2-b28fbb6781b1</serial>
Nov 19 14:50:28 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:50:28 user nova-compute[74934]: </disk>
Nov 19 14:50:28 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:50:28 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:50:28 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:50:28 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:50:28</nova:creationTime>
Nov 19 14:50:28 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:50:28 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:50:28 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:50:28 user nova-compute[74934]:   <nova:owner>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:50:28 user nova-compute[74934]:   </nova:owner>
Nov 19 14:50:28 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:50:28 user nova-compute[74934]:   <nova:ports>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:50:28 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:50:28 user nova-compute[74934]:     </nova:port>
Nov 19 14:50:28 user nova-compute[74934]:     <nova:port uuid="a4c5c9bb-69dc-4333-ae96-ae4bfe37f839">
Nov 19 14:50:28 user nova-compute[74934]:       <nova:ip type="fixed" address="10.10.10.203" ipVersion="4"/>
Nov 19 14:50:28 user nova-compute[74934]:     </nova:port>
Nov 19 14:50:28 user nova-compute[74934]:   </nova:ports>
Nov 19 14:50:28 user nova-compute[74934]: </nova:instance>
Nov 19 14:50:28 user nova-compute[74934]:  {{(pid=74934) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a441c12-a4b7-431f-837e-df4f30931a02 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "interface-b7614315-a839-4dbf-8137-9b4a096bea5b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.747s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:28 user nova-compute[74934]: INFO nova.compute.manager [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Attaching volume d40ecd8e-7930-420d-aab7-a745c6222a9b to /dev/vdb
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.utils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1596fd5-5072-46c8-af2a-3f5402fc1faf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.network.neutron [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updated VIF entry in instance network info cache for port 717622fa-a1ff-4988-9e16-f399ba8f9020. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.network.neutron [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updating instance_info_cache with network_info: [{"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2f99e2df-f29c-4271-84f6-229f51bb5105 req-4b93991b-5d76-4ce9-919b-3e1078c24b80 service nova] Releasing lock "refresh_cache-60dddb96-ee81-4cc8-8960-7e0189d4543b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de17248-5a8c-4f58-bbf0-27019265bb1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c932d-2330-4dac-8611-5faa34fcf496]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[57184846-a6f3-44dc-b142-1024f0dd80fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:28 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec607281-36ee-4c60-ac62-baf2056ada85]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.utils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updating existing volume attachment record: 09a6700f-6517-4bf3-9aca-38ad7ba346c0 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'flavor' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:28 user nova-compute[74934]: INFO nova.compute.manager [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Attaching volume 19d61ce4-43f6-4db1-870d-e42d570aa8b0 to /dev/vdb
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.utils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4e936-c637-48da-9823-6e00dd17affc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e7d41-9315-41f8-86f1-be43c1430e45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[83464748-5a8e-482b-b89d-28de3f3c1c7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d151658-6156-42c8-84a0-1e9a61af4998]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:28 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:28 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04b7c9-e7ae-41b9-b0db-aab6320f7ad5]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG os_brick.utils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:28 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating existing volume attachment record: c82a93d6-5da0-494c-8ef7-9aa05ff174a3 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:29 user nova-compute[74934]: WARNING nova.compute.manager [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 for instance with vm_state active and task_state None.
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:29 user nova-compute[74934]: WARNING nova.compute.manager [req-678eec63-599d-4ab5-9535-24ece2ae6039 req-b512ec9d-4d0d-4c74-b310-67d22b24d868 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 for instance with vm_state active and task_state None.
Nov 19 14:50:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:29 user nova-compute[74934]: INFO nova.compute.manager [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Detaching volume f63df33b-6083-4c4b-aa82-5b44adb27f22
Nov 19 14:50:29 user nova-compute[74934]: INFO nova.virt.block_device [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Attempting to driver detach volume f63df33b-6083-4c4b-aa82-5b44adb27f22 from mountpoint /dev/sdc
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Attempting to detach device sdc from instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:29 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:29 user nova-compute[74934]:   <source dev="/dev/sdi"/>
Nov 19 14:50:29 user nova-compute[74934]:   <target dev="sdc" bus="scsi"/>
Nov 19 14:50:29 user nova-compute[74934]:   <serial>f63df33b-6083-4c4b-aa82-5b44adb27f22</serial>
Nov 19 14:50:29 user nova-compute[74934]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 19 14:50:29 user nova-compute[74934]: </disk>
Nov 19 14:50:29 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Successfully detached device sdc from instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 from the persistent domain config.
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:50:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:29 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:29 user nova-compute[74934]:   <source dev="/dev/sdi"/>
Nov 19 14:50:29 user nova-compute[74934]:   <target dev="sdc" bus="scsi"/>
Nov 19 14:50:29 user nova-compute[74934]:   <serial>f63df33b-6083-4c4b-aa82-5b44adb27f22</serial>
Nov 19 14:50:29 user nova-compute[74934]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 19 14:50:29 user nova-compute[74934]: </disk>
Nov 19 14:50:29 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:50:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:34 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:34 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:34 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2206b6-2dde-46a6-8bc1-8c8932f63e5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:34 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b591f-c69b-4490-a69d-05cf61194aab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b] added
Nov 19 14:50:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713ba4e-4150-45f6-8974-6c4e23cc02d1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[182a73f2-742b-42dd-8ae9-3a3188008906]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfaGpDlL {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfaGpDlL" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b9874-3c64-417e-b0eb-fbb71f7ccda2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfaGpDlL'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[77849f01-832c-4e62-bad7-8517289ac4f1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3003f212-7398-4242-8a67-d8685a94acfa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eb28bc-6bfb-48b6-9134-dee2b9565403]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]
Nov 19 14:50:34 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2d6af-ebaa-453e-9d20-1fd417272dd2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b10a0eb-1805-4ab5-ac80-762323dda44a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab67af09-c005-42ce-8698-e5f1ce27e003]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YInMwQoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:35 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-changed-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Refreshing instance network info cache due to event network-changed-b687d602-81e2-4dab-bca7-db920bdf634b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] Acquiring lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] Acquired lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.network.neutron [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Refreshing network info cache for port b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.objects.instance [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lazy-loading 'flavor' on Instance uuid bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23063393934303332', 'path': '/dev/sdj'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063393934303332', 'path': '/dev/sdj'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.563s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:35 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:35 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lazy-loading 'flavor' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ddb4c8-c5db-4535-8c53-4abd4ce46772]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:35 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:50:35 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:35 user nova-compute[74934]:   <source dev="/dev/sdj"/>
Nov 19 14:50:35 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:35 user nova-compute[74934]:   <serial>d40ecd8e-7930-420d-aab7-a745c6222a9b</serial>
Nov 19 14:50:35 user nova-compute[74934]: </disk>
Nov 19 14:50:35 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[703d1216-064a-4016-b7bc-0a6502cf1542]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0] added
Nov 19 14:50:35 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[120806ff-3966-4264-9f1c-a2527dea3576]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0696ead-95e9-42fd-8f09-77d63fb10a20]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YInMwQoi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YInMwQoi" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b0e66-4c67-4455-8dfd-2b153139a464]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YInMwQoi'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b22f3ff-9461-406a-887a-3b3816632f87]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:36 user nova-compute[74934]: INFO nova.compute.manager [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Attaching volume 221e4d17-4381-49da-9c16-5c47079cd5b6 to /dev/vdb
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c04e77-0c94-4ac8-ac53-e0d39b315911]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.utils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d4e1d-cccb-40dd-a666-2a0f15be814f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc03b27-2aab-4de8-bef0-a0fbf6fefb3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[46810600-27dc-41e5-88ad-8b7c1e464d7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260]
Nov 19 14:50:36 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d63c8-caa0-4bbe-8456-bcf7476bd125]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d83eb8-fd17-4ff4-ad7d-8e946d961e4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[85554fbe-39d3-4e36-a2e8-a7da86bd9320]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updated VIF entry in instance network info cache for port b687d602-81e2-4dab-bca7-db920bdf634b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updating instance_info_cache with network_info: [{"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:36 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6973ecec-d9a6-4138-b13a-626e1f656c76]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.utils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updating existing volume attachment record: 561b6663-2953-47d8-a094-1f03ed6beffd {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-574790a1-2f2b-4db7-bdf4-c5d76748b33c req-aa6e63c9-db6e-4d20-9a16-daa12ee1c4cb service nova] Releasing lock "refresh_cache-bc1c6696-09e5-487d-a9bf-0530f2fc5295" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af31903-0d2c-4ac1-919c-7a667db392e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e300277-918c-4089-897a-3ae947d6b087]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YInMwQoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] No VIF found with MAC fa:16:3e:09:58:ef, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:50:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d30dd357-cc4c-4d45-9557-f5d7291a4fc4 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.228s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] <== connect_volume: return (2017ms) {'type': 'block', 'scsi_wwn': '23536623435336162', 'path': '/dev/sdk'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536623435336162', 'path': '/dev/sdk'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'flavor' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:50:37 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:37 user nova-compute[74934]:   <source dev="/dev/sdk"/>
Nov 19 14:50:37 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:37 user nova-compute[74934]:   <serial>19d61ce4-43f6-4db1-870d-e42d570aa8b0</serial>
Nov 19 14:50:37 user nova-compute[74934]: </disk>
Nov 19 14:50:37 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.utils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabfeb12-17d2-48b1-8c44-4b8f9b48d2e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee65b70-d9c9-4712-929f-d354618249f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf7be7e-9153-447c-9471-89226a6b1d51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[de937236-4cf9-496f-a0ed-206cd0118f75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:37 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca67050-f96f-4159-81df-5a79c7cee285]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG os_brick.utils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:37 user nova-compute[74934]: INFO nova.compute.manager [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Swapping volume d40ecd8e-7930-420d-aab7-a745c6222a9b for a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:50:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No BDM found with device name hda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] No VIF found with MAC fa:16:3e:7d:a1:30, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:50:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-32ba85ce-acf7-4ce9-8f6d-4ca2d8269c0a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.228s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:39 user nova-compute[74934]: INFO nova.compute.manager [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Detaching volume 19d61ce4-43f6-4db1-870d-e42d570aa8b0
Nov 19 14:50:39 user nova-compute[74934]: INFO nova.virt.block_device [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Attempting to driver detach volume 19d61ce4-43f6-4db1-870d-e42d570aa8b0 from mountpoint /dev/vdb
Nov 19 14:50:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Attempting to detach device vdb from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:50:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:39 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:39 user nova-compute[74934]:   <source dev="/dev/sdk"/>
Nov 19 14:50:39 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:39 user nova-compute[74934]:   <serial>19d61ce4-43f6-4db1-870d-e42d570aa8b0</serial>
Nov 19 14:50:39 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 19 14:50:39 user nova-compute[74934]: </disk>
Nov 19 14:50:39 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully detached device vdb from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the persistent domain config.
Nov 19 14:50:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:50:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:39 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:39 user nova-compute[74934]:   <source dev="/dev/sdk"/>
Nov 19 14:50:39 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:39 user nova-compute[74934]:   <serial>19d61ce4-43f6-4db1-870d-e42d570aa8b0</serial>
Nov 19 14:50:39 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 19 14:50:39 user nova-compute[74934]: </disk>
Nov 19 14:50:39 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCXzRBcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:42 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:42 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:42 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[64256e36-ca8f-4055-9939-8bc0f6a4741b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:42 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a3326-af11-4829-82e3-0db046cca221]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6] added
Nov 19 14:50:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43fdf64-6889-42e7-b80d-eb1a3f277c9d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d40091-d292-417a-92dd-35d7f6a9194f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCXzRBcQ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lCXzRBcQ" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c61e6-1749-47e3-b198-1f986fbd49f1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lCXzRBcQ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[38910b32-7308-4227-8e1a-9f993bf47605]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2216b4c3-e840-40c2-ad9a-563ab0e2c0e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ac851-865d-44eb-ad6b-22016cc6307c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260]
Nov 19 14:50:42 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a10d213-3e41-44b3-b49a-3ab313d848d0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e3df53-fbb7-4f92-b9c7-47b2a9de5412]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7db61d-95eb-46e6-9466-188aea16e228]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCXzRBcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26231653334633937', 'path': '/dev/sdl'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231653334633937', 'path': '/dev/sdl'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:50:43 user nova-compute[74934]: DEBUG nova.objects.instance [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lazy-loading 'flavor' on Instance uuid bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] attach device xml: <disk type="block" device="disk">
Nov 19 14:50:43 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:43 user nova-compute[74934]:   <source dev="/dev/sdl"/>
Nov 19 14:50:43 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:43 user nova-compute[74934]:   <serial>221e4d17-4381-49da-9c16-5c47079cd5b6</serial>
Nov 19 14:50:43 user nova-compute[74934]: </disk>
Nov 19 14:50:43 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMwPzQUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60dddb96-ee81-4cc8-8960-7e0189d4543b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a42acc34-16eb-4753-a910-2c9dafb3e7be', 'serial': 'a42acc34-16eb-4753-a910-2c9dafb3e7be'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '60dddb96-ee81-4cc8-8960-7e0189d4543b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd40ecd8e-7930-420d-aab7-a745c6222a9b', 'serial'} {{(pid=74934) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMwPzQUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:44 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:44 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:44 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13b305-574a-4b7e-910f-708bc13332d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:44 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d8e027-b7cc-4eee-b40b-e96b126e2ce1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be] added
Nov 19 14:50:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c75522d-ef57-47a1-93f2-3d1379972bba]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3e240d-13d4-418e-a9bd-1c280cbd3105]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMwPzQUS {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMwPzQUS" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c77a04-8dc3-40a9-8509-c73652bca136]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMwPzQUS'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] No VIF found with MAC fa:16:3e:36:f6:86, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a041f0aa-014f-4ce0-9fd0-506582ae7b6f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a89e291-6ae8-4598-a1c5-dd7d5a6e4ad4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-082398b8-df64-4454-8161-648cb9a7473d tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.310s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec45045-de1f-49ab-bc7d-fd0386367737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260]
Nov 19 14:50:44 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84aa140-cea3-48ad-addf-56bbdf5e167b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a294cc6-79aa-4186-b030-85634c22eaf9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] HCTL ('44', '-', '-', 0) found on session 13 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[336afdca-8eb5-45b7-9c3b-bb5ec5ddc949]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Searching for a device in session 13 and hctl ['44', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] volume_snapshot_create: create_info: {'snapshot_id': '29cf341f-4fd4-496f-b429-777085a2483d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74934) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] snap xml: <domainsnapshot>
Nov 19 14:50:44 user nova-compute[74934]:   <disks>
Nov 19 14:50:44 user nova-compute[74934]:     <disk name="/dev/sdl" snapshot="external" type="file">
Nov 19 14:50:44 user nova-compute[74934]:       <source file="/dev/new_file"/>
Nov 19 14:50:44 user nova-compute[74934]:     </disk>
Nov 19 14:50:44 user nova-compute[74934]:     <disk name="vda" snapshot="no"/>
Nov 19 14:50:44 user nova-compute[74934]:   </disks>
Nov 19 14:50:44 user nova-compute[74934]: </domainsnapshot>
Nov 19 14:50:44 user nova-compute[74934]:  {{(pid=74934) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 19 14:50:44 user nova-compute[74934]: DEBUG nova.objects.instance [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] Lazy-loading 'system_metadata' on Instance uuid bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     rv = execute(f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     six.reraise(c, e, tb)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     raise value
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     rv = meth(*args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     self._volume_snapshot_create(context, instance, guest,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     rv = execute(f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     six.reraise(c, e, tb)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     raise value
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     rv = meth(*args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] 
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c7a62ad9-39a6-43fd-9233-a73f7ff2dd15 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] volume_snapshot_delete: delete_info: {'volume_id': '221e4d17-4381-49da-9c16-5c47079cd5b6'} {{(pid=74934) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [None req-c7a62ad9-39a6-43fd-9233-a73f7ff2dd15 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295]     if delete_info['type'] != 'qcow2':
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] KeyError: 'type'
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 29cf341f-4fd4-496f-b429-777085a2483d could not be found.
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise value
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 29cf341f-4fd4-496f-b429-777085a2483d could not be found. (HTTP 404) (Request-ID: req-f5886e35-41a4-459f-bcac-2c012add425b)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 29cf341f-4fd4-496f-b429-777085a2483d could not be found.
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver [None req-c7a62ad9-39a6-43fd-9233-a73f7ff2dd15 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-60748f60-1213-48dd-b48e-c6802c43fb7e)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 19 14:50:45 user nova-compute[74934]: ERROR nova.virt.libvirt.driver 
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server [None req-7d43d09c-fa1f-4059-9a92-95b9b6b38197 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     raise value
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server 
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server [None req-c7a62ad9-39a6-43fd-9233-a73f7ff2dd15 tempest-VolumesAssistedSnapshotsTest-2071922147 tempest-VolumesAssistedSnapshotsTest-2071922147-project] Exception during message handling: KeyError: 'type'
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 19 14:50:45 user nova-compute[74934]: ERROR oslo_messaging.rpc.server 
Nov 19 14:50:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:45 user nova-compute[74934]: INFO nova.compute.manager [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Detaching volume 221e4d17-4381-49da-9c16-5c47079cd5b6
Nov 19 14:50:45 user nova-compute[74934]: INFO nova.virt.block_device [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Attempting to driver detach volume 221e4d17-4381-49da-9c16-5c47079cd5b6 from mountpoint /dev/vdb
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Attempting to detach device vdb from instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:45 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:45 user nova-compute[74934]:   <source dev="/dev/sdl"/>
Nov 19 14:50:45 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:45 user nova-compute[74934]:   <serial>221e4d17-4381-49da-9c16-5c47079cd5b6</serial>
Nov 19 14:50:45 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:50:45 user nova-compute[74934]: </disk>
Nov 19 14:50:45 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Successfully detached device vdb from instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 from the persistent domain config.
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] detach device xml: <disk type="block" device="disk">
Nov 19 14:50:45 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:50:45 user nova-compute[74934]:   <source dev="/dev/sdl"/>
Nov 19 14:50:45 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:50:45 user nova-compute[74934]:   <serial>221e4d17-4381-49da-9c16-5c47079cd5b6</serial>
Nov 19 14:50:45 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:50:45 user nova-compute[74934]: </disk>
Nov 19 14:50:45 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Searching for a device in session 13 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMwPzQUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23237633261336363', 'path': '/dev/sdm'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237633261336363', 'path': '/dev/sdm'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.objects.instance [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lazy-loading 'flavor' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:50:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 74448896 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 183500800 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 339738624 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 497025024 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8b33af6a-67df-485c-84d9-ce224f78e67c is timed out.
Nov 19 14:50:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Successfully detached device vdb from instance 8b33af6a-67df-485c-84d9-ce224f78e67c from the live domain config.
Nov 19 14:50:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pzQnVUml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:48 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021a10f-0de6-43dd-a6c0-a66f15d1772e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:50:48 user nova-compute[74934]: No targets found.
Nov 19 14:50:48 user nova-compute[74934]: iSNS:
Nov 19 14:50:48 user nova-compute[74934]: No targets found.
Nov 19 14:50:48 user nova-compute[74934]: STATIC:
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb
Nov 19 14:50:48 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:48 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:48 user nova-compute[74934]: FIRMWARE:
Nov 19 14:50:48 user nova-compute[74934]: No targets found.
Nov 19 14:50:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:50:48 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:50:48 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbc33c5-d271-4aec-b046-eb7ac0d60d7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8361142d-42ac-4378-8448-99ad9b9fcfba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fdfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1'): ({'sdh'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Removing single pathed devices sdh {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa39767-87c7-49b8-9eda-2dcd7f2b847c]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 638582784 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a498b40c-d7e0-4d6b-a72a-5191bf816204]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Flushing IO for device /dev/sdh {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae4006-c2b2-44f5-89a8-34f369c2e131]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4303b-9d12-4b18-8bd9-fc64e41ede39]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] SCSI volumes sdh have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68ac39-158e-41de-81fc-cf392d7452af]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc5bc7e-556e-4b5a-87ce-3f50075a2726]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260]
Nov 19 14:50:48 user nova-compute[74934]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e924d19-7a0c-4b71-92c2-b28fbb6781b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[142314e4-e485-4d86-9a8d-23e9621cc442]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] <== disconnect_volume: return (450ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 781189120 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "2764ee50-8167-4303-af46-c15e6e354f81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:49 user nova-compute[74934]: INFO nova.compute.manager [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Terminating instance
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee760dce-6720-4598-a2e3-619e2490c80b req-d87301cd-412e-43c6-aac4-9816e597df63 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-vif-unplugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee760dce-6720-4598-a2e3-619e2490c80b req-d87301cd-412e-43c6-aac4-9816e597df63 service nova] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee760dce-6720-4598-a2e3-619e2490c80b req-d87301cd-412e-43c6-aac4-9816e597df63 service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee760dce-6720-4598-a2e3-619e2490c80b req-d87301cd-412e-43c6-aac4-9816e597df63 service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee760dce-6720-4598-a2e3-619e2490c80b req-d87301cd-412e-43c6-aac4-9816e597df63 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] No waiting events found dispatching network-vif-unplugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee760dce-6720-4598-a2e3-619e2490c80b req-d87301cd-412e-43c6-aac4-9816e597df63 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-vif-unplugged-87bd824d-cf90-4a95-8898-b9227a626ff9 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:50:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 is timed out.
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Successfully detached device sdc from instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 from the live domain config.
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OeEDbdZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:50 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f94a6-c872-4c21-925c-f1d79fb07e44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:50:50 user nova-compute[74934]: No targets found.
Nov 19 14:50:50 user nova-compute[74934]: iSNS:
Nov 19 14:50:50 user nova-compute[74934]: No targets found.
Nov 19 14:50:50 user nova-compute[74934]: STATIC:
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: FIRMWARE:
Nov 19 14:50:50 user nova-compute[74934]: No targets found.
Nov 19 14:50:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:50:50 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:50:50 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5bb5e-2d51-4721-8124-64a5cb8a0a56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0dc94c-dd41-4c7b-9d09-e6d28b818e0f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 (non-flash)
Nov 19 14:50:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fd870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22'): ({'sdi'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Removing single pathed devices sdi {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc20720c-980f-459a-a1ee-ccb4aa6e2f47]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Instance destroyed successfully.
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lazy-loading 'resources' on Instance uuid 2764ee50-8167-4303-af46-c15e6e354f81 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e826a790-e947-4d83-ac46-df888fcbac8b]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Flushing IO for device /dev/sdi {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1883692123',display_name='tempest-VolumesNegativeTest-instance-1883692123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1883692123',id=11,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9faa940e4d1f4cd2a0d6326c982c3f57',ramdisk_id='',reservation_id='r-hgrauau8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1661661215',owner_user_name='tempest-VolumesNegativeTest-1661661215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:08Z,user_data=None,user_id='ff2ce81d95784e2ca1a7ed417aec0ad3',uuid=2764ee50-8167-4303-af46-c15e6e354f81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Converting VIF {"id": "87bd824d-cf90-4a95-8898-b9227a626ff9", "address": "fa:16:3e:6f:ec:7d", "network": {"id": "c8c68f2b-30a1-4491-b58b-eeb6b01a3218", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "cab4cffaa7df4895a59e3dbe3422c928", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bd824d-cf", "ovs_interfaceid": "87bd824d-cf90-4a95-8898-b9227a626ff9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_vif [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87bd824d-cf, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dedf382-32a7-4af4-9dd8-b18a73de7e4f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=809b242f-9de2-422b-b021-845394321c1f) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:50 user nova-compute[74934]: INFO os_vif [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ec:7d,bridge_name='br-int',has_traffic_filtering=True,id=87bd824d-cf90-4a95-8898-b9227a626ff9,network=Network(c8c68f2b-30a1-4491-b58b-eeb6b01a3218),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bd824d-cf')
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Deleting instance files /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81_del
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Deletion of /opt/stack/data/nova/instances/2764ee50-8167-4303-af46-c15e6e354f81_del complete
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.066s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb10151-7ade-449e-8881-f289ce9d44ed]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] SCSI volumes sdi have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 1049624576 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'flavor' on Instance uuid 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acd9bf3-ae22-4d12-b769-8b7416d863c1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.compute.manager [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8427c4b1-f5fb-486c-b0c8-7e3d0ed87fb7 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.512s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[010183e5-fdd2-4fce-a491-d717377eab40]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260]
Nov 19 14:50:50 user nova-compute[74934]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f63df33b-6083-4c4b-aa82-5b44adb27f22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2c6a67-3e07-43d4-9ae2-9c890446865f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] <== disconnect_volume: return (457ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:50 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-85a12b5e-d4b4-46b9-a853-2d71d5b97693 req-bf7fd83e-64e2-44bc-a2f8-f596107265b0 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-vif-deleted-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.compute.manager [req-85a12b5e-d4b4-46b9-a853-2d71d5b97693 req-bf7fd83e-64e2-44bc-a2f8-f596107265b0 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Neutron deleted interface 87bd824d-cf90-4a95-8898-b9227a626ff9; detaching it from the instance and deleting it from the info cache
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-85a12b5e-d4b4-46b9-a853-2d71d5b97693 req-bf7fd83e-64e2-44bc-a2f8-f596107265b0 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:50 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Took 0.60 seconds to deallocate network for instance.
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bdd0ea-5e04-4605-a457-26c6a0e69abc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:50:50 user nova-compute[74934]: No targets found.
Nov 19 14:50:50 user nova-compute[74934]: iSNS:
Nov 19 14:50:50 user nova-compute[74934]: No targets found.
Nov 19 14:50:50 user nova-compute[74934]: STATIC:
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb
Nov 19 14:50:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:50:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:50:50 user nova-compute[74934]: FIRMWARE:
Nov 19 14:50:50 user nova-compute[74934]: No targets found.
Nov 19 14:50:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:50:50 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:50:50 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-85a12b5e-d4b4-46b9-a853-2d71d5b97693 req-bf7fd83e-64e2-44bc-a2f8-f596107265b0 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Detach interface failed, port_id=87bd824d-cf90-4a95-8898-b9227a626ff9, reason: Instance 2764ee50-8167-4303-af46-c15e6e354f81 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cb1c42-78be-4453-8727-7a88bb85ee87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7537ce3-5e45-42d9-a94f-e0201b67804a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:51 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43ff400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b'): ({'sdj'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Removing single pathed devices sdj {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fff225-45fd-4bfb-bd61-654cab31c9f5]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad77122-88bf-4939-a837-d530221a007a]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Flushing IO for device /dev/sdj {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[78352c09-4aa1-4eed-97d8-95feb3ffe016]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8622d9ba-c485-4e6e-b36c-b48f6f9f3123]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] SCSI volumes sdj have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b079fb-5986-42c6-8416-8bb9cd85a324]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[859fe9aa-5231-41e0-9d44-7679453deae8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]
Nov 19 14:50:51 user nova-compute[74934]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lazy-loading 'flavor' on Instance uuid 2e319dfa-bb7c-461a-a408-c8f7edf6c221 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67b368-e44b-495d-9053-b659822f2f4a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] <== disconnect_volume: return (377ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMwPzQUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': '60dddb96-ee81-4cc8-8960-7e0189d4543b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a42acc34-16eb-4753-a910-2c9dafb3e7be', 'serial'} {{(pid=74934) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] swap_volume: removing Cinder connection for volume d40ecd8e-7930-420d-aab7-a745c6222a9b {{(pid=74934) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6ed4bb64-2068-4c02-8173-38ae09d21d4d tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:51 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Deleted allocations for instance 2764ee50-8167-4303-af46-c15e6e354f81
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e3fd5761-67ff-496c-9ef5-be4be9ed9d6f tempest-VolumesNegativeTest-1661661215 tempest-VolumesNegativeTest-1661661215-project-member] Lock "2764ee50-8167-4303-af46-c15e6e354f81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.250s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-a7208c33-9e71-4a94-862d-6810b55190a2 req-80792bac-746d-4bf6-ba77-ec6cd7910b51 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received event network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a7208c33-9e71-4a94-862d-6810b55190a2 req-80792bac-746d-4bf6-ba77-ec6cd7910b51 service nova] Acquiring lock "2764ee50-8167-4303-af46-c15e6e354f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a7208c33-9e71-4a94-862d-6810b55190a2 req-80792bac-746d-4bf6-ba77-ec6cd7910b51 service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a7208c33-9e71-4a94-862d-6810b55190a2 req-80792bac-746d-4bf6-ba77-ec6cd7910b51 service nova] Lock "2764ee50-8167-4303-af46-c15e6e354f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-a7208c33-9e71-4a94-862d-6810b55190a2 req-80792bac-746d-4bf6-ba77-ec6cd7910b51 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] No waiting events found dispatching network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:51 user nova-compute[74934]: WARNING nova.compute.manager [req-a7208c33-9e71-4a94-862d-6810b55190a2 req-80792bac-746d-4bf6-ba77-ec6cd7910b51 service nova] [instance: 2764ee50-8167-4303-af46-c15e6e354f81] Received unexpected event network-vif-plugged-87bd824d-cf90-4a95-8898-b9227a626ff9 for instance with vm_state deleted and task_state None.
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:51 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] swap_volume: Updating volume d40ecd8e-7930-420d-aab7-a745c6222a9b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BMwPzQUS", "auth_password": "gOFysSmWJwxrTl", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "a42acc34-16eb-4753-a910-2c9dafb3e7be"}, "status": "reserved", "instance": "60dddb96-ee81-4cc8-8960-7e0189d4543b", "attached_at": "", "detached_at": "", "volume_id": "a42acc34-16eb-4753-a910-2c9dafb3e7be", "serial": "a42acc34-16eb-4753-a910-2c9dafb3e7be"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a42acc34-16eb-4753-a910-2c9dafb3e7be', 'no_device': None, 'attachment_id': '2bda6bc4-1f04-4f85-86e2-093950bd5f33'} {{(pid=74934) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-930d1d51-6add-4c6b-b688-4c0ee1a3eead tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.664s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:52 user nova-compute[74934]: INFO nova.compute.manager [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Terminating instance
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-b763c757-1159-4831-8806-b47545672e26 req-3a8bc871-26a1-4d9f-8ff2-de107382d24c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-vif-unplugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b763c757-1159-4831-8806-b47545672e26 req-3a8bc871-26a1-4d9f-8ff2-de107382d24c service nova] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b763c757-1159-4831-8806-b47545672e26 req-3a8bc871-26a1-4d9f-8ff2-de107382d24c service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b763c757-1159-4831-8806-b47545672e26 req-3a8bc871-26a1-4d9f-8ff2-de107382d24c service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-b763c757-1159-4831-8806-b47545672e26 req-3a8bc871-26a1-4d9f-8ff2-de107382d24c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] No waiting events found dispatching network-vif-unplugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-b763c757-1159-4831-8806-b47545672e26 req-3a8bc871-26a1-4d9f-8ff2-de107382d24c service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-vif-unplugged-e29f0db5-7542-47c0-a806-709a6982344e for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_brick.utils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221a446-e948-44ee-a805-9909a1646629]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8b2e2-6d1e-47b9-90dd-3e6f693fa86e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c58b33-687d-4663-a284-4af6a2fed16c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7f7dc-f0b9-413f-a136-19f4f33ef824]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:50:53 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a6ff35-cb9a-44f8-8a07-f77301e9faf6]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_brick.utils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:50:53 user nova-compute[74934]: INFO nova.compute.manager [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Swapping volume a42acc34-16eb-4753-a910-2c9dafb3e7be for d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Instance destroyed successfully.
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lazy-loading 'resources' on Instance uuid 2e319dfa-bb7c-461a-a408-c8f7edf6c221 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-619053951',display_name='tempest-AttachSCSIVolumeTestJSON-server-619053951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-619053951',id=7,image_ref='a99df65f-f80d-4c57-81f8-48db9486e1aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtStTblgPv+8QGVCuHbBc1FEc9i977mmGJGiS3w+wkF8VU/mzTx8CL/5l1uGaL7JKbiILkB8HXwApsLRUv41IaJ/3Y8Sx+F/4mhNuxBmQeaGuOULtz1aKdvidcARYnznQ==',key_name='tempest-keypair-875654113',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3964523815cf488dabb1ecae9c4b70a7',ramdisk_id='',reservation_id='r-2bg09ks0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99df65f-f80d-4c57-81f8-48db9486e1aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-320927024',owner_user_name='tempest-AttachSCSIVolumeTestJSON-320927024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60694a255c3d415ab100a0d7d8fefb05',uuid=2e319dfa-bb7c-461a-a408-c8f7edf6c221,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Converting VIF {"id": "e29f0db5-7542-47c0-a806-709a6982344e", "address": "fa:16:3e:8f:e0:bb", "network": {"id": "1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-552694453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3964523815cf488dabb1ecae9c4b70a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape29f0db5-75", "ovs_interfaceid": "e29f0db5-7542-47c0-a806-709a6982344e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG os_vif [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape29f0db5-75, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96ae72f0-6d18-4a13-8f6f-a58645b7e32c) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:53 user nova-compute[74934]: INFO os_vif [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:e0:bb,bridge_name='br-int',has_traffic_filtering=True,id=e29f0db5-7542-47c0-a806-709a6982344e,network=Network(1f152b5c-a5a1-4d93-bd74-90a8f3d1f2f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape29f0db5-75')
Nov 19 14:50:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Deleting instance files /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221_del
Nov 19 14:50:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Deletion of /opt/stack/data/nova/instances/2e319dfa-bb7c-461a-a408-c8f7edf6c221_del complete
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: INFO nova.compute.manager [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-ac3ff6dd-ec32-434b-bdd3-d93b533fd91f req-62aa8377-4a94-41ef-ae2d-ac0be3ff6d56 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-vif-deleted-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:54 user nova-compute[74934]: INFO nova.compute.manager [req-ac3ff6dd-ec32-434b-bdd3-d93b533fd91f req-62aa8377-4a94-41ef-ae2d-ac0be3ff6d56 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Neutron deleted interface e29f0db5-7542-47c0-a806-709a6982344e; detaching it from the instance and deleting it from the info cache
Nov 19 14:50:54 user nova-compute[74934]: DEBUG nova.network.neutron [req-ac3ff6dd-ec32-434b-bdd3-d93b533fd91f req-62aa8377-4a94-41ef-ae2d-ac0be3ff6d56 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:54 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Took 0.84 seconds to deallocate network for instance.
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-ac3ff6dd-ec32-434b-bdd3-d93b533fd91f req-62aa8377-4a94-41ef-ae2d-ac0be3ff6d56 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Detach interface failed, port_id=e29f0db5-7542-47c0-a806-709a6982344e, reason: Instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:50:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:54 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Deleted allocations for instance 2e319dfa-bb7c-461a-a408-c8f7edf6c221
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-921b7a78-fd66-4c55-b2d7-8318bc859fb4 req-6c995525-a6c3-495c-8c86-daf396a02138 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received event network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-921b7a78-fd66-4c55-b2d7-8318bc859fb4 req-6c995525-a6c3-495c-8c86-daf396a02138 service nova] Acquiring lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-921b7a78-fd66-4c55-b2d7-8318bc859fb4 req-6c995525-a6c3-495c-8c86-daf396a02138 service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-921b7a78-fd66-4c55-b2d7-8318bc859fb4 req-6c995525-a6c3-495c-8c86-daf396a02138 service nova] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-921b7a78-fd66-4c55-b2d7-8318bc859fb4 req-6c995525-a6c3-495c-8c86-daf396a02138 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] No waiting events found dispatching network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:50:55 user nova-compute[74934]: WARNING nova.compute.manager [req-921b7a78-fd66-4c55-b2d7-8318bc859fb4 req-6c995525-a6c3-495c-8c86-daf396a02138 service nova] [instance: 2e319dfa-bb7c-461a-a408-c8f7edf6c221] Received unexpected event network-vif-plugged-e29f0db5-7542-47c0-a806-709a6982344e for instance with vm_state deleted and task_state None.
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b08ee2ba-f7b8-4d93-9d2c-de015b923bbd tempest-AttachSCSIVolumeTestJSON-320927024 tempest-AttachSCSIVolumeTestJSON-320927024-project-member] Lock "2e319dfa-bb7c-461a-a408-c8f7edf6c221" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:50:56 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:50:56 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.409507751464844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 8b33af6a-67df-485c-84d9-ce224f78e67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b7614315-a839-4dbf-8137-9b4a096bea5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60dddb96-ee81-4cc8-8960-7e0189d4543b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0ae17df3-ca5b-432a-8975-7e94b549e19e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance a5ed99bc-03bb-48f8-ab95-9c79adf3fe43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:50:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-changed-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing instance network info cache due to event network-changed-9ded98a8-0885-42aa-9a15-9601389e55b8. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] Acquiring lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] Acquired lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG nova.network.neutron [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Refreshing network info cache for port 9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG nova.network.neutron [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updated VIF entry in instance network info cache for port 9ded98a8-0885-42aa-9a15-9601389e55b8. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG nova.network.neutron [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-352927b5-0633-420a-bd58-09071699c426 req-8ce9bb66-da2e-45a6-870d-df107c085dab service nova] Releasing lock "refresh_cache-0ae17df3-ca5b-432a-8975-7e94b549e19e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:50:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:50:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60dddb96-ee81-4cc8-8960-7e0189d4543b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd40ecd8e-7930-420d-aab7-a745c6222a9b', 'serial': 'd40ecd8e-7930-420d-aab7-a745c6222a9b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMwPzQUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'a42acc34-16eb-4753-a910-2c9dafb3e7be'}, 'status': 'reserved', 'instance': '60dddb96-ee81-4cc8-8960-7e0189d4543b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a42acc34-16eb-4753-a910-2c9dafb3e7be', 'serial'} {{(pid=74934) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:59 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:59 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:50:59 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b389995d-26d4-4c6f-923a-c0105c7594fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:50:59 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3206849-c58e-489a-bbb5-9bf6ba1e1f0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b] added
Nov 19 14:50:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd434e45-443a-47d0-b8c5-506ae8604f01]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-changed-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing instance network info cache due to event network-changed-1a4a6bac-437f-425d-8bd1-3703b536e668. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] Acquiring lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] Acquired lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Refreshing network info cache for port 1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc70dad-d43f-4a7b-ae7e-325d99d9062e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfaGpDlL {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfaGpDlL" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3003b9fa-4960-4a99-b5b6-4ab303b6fd52]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfaGpDlL'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8692b-f21d-40e4-9338-3a5d8cce14d1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c583d87-4faf-4ad6-86c1-3bf99c14b968]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fa742a-a1f5-49b8-9f6d-9f8a2a44ec00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]
Nov 19 14:50:59 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.
Nov 19 14:50:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[581afcfd-72a0-4875-a84e-5223b0f57986]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37901e0-f01d-42fb-a8b8-c3dd5cf24b7b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:50:59 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:50:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[386c3a1f-acef-4886-aab1-5176bfd15abf]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:50:59 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b7614315-a839-4dbf-8137-9b4a096bea5b is timed out.
Nov 19 14:50:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully detached device vdb from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the live domain config.
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YInMwQoi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:50:59 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:50:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:50:59 user nova-compute[74934]: INFO nova.compute.manager [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Terminating instance
Nov 19 14:50:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:50:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.network.neutron [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updated VIF entry in instance network info cache for port 1a4a6bac-437f-425d-8bd1-3703b536e668. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.network.neutron [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [{"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e987b151-2cff-4b48-a6a8-6e46c29641a4 req-6a5ef8b4-0d8b-4939-9996-8f2ce14fbe72 service nova] Releasing lock "refresh_cache-a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-95f52e1a-7fe5-4f9d-b262-8af97dfb52c9 req-cbc21b1c-eadd-4780-80ce-60253d61fa39 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-95f52e1a-7fe5-4f9d-b262-8af97dfb52c9 req-cbc21b1c-eadd-4780-80ce-60253d61fa39 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-95f52e1a-7fe5-4f9d-b262-8af97dfb52c9 req-cbc21b1c-eadd-4780-80ce-60253d61fa39 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-95f52e1a-7fe5-4f9d-b262-8af97dfb52c9 req-cbc21b1c-eadd-4780-80ce-60253d61fa39 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-95f52e1a-7fe5-4f9d-b262-8af97dfb52c9 req-cbc21b1c-eadd-4780-80ce-60253d61fa39 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-95f52e1a-7fe5-4f9d-b262-8af97dfb52c9 req-cbc21b1c-eadd-4780-80ce-60253d61fa39 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-9ded98a8-0885-42aa-9a15-9601389e55b8 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-16f0017a-1d3b-426f-adeb-987a344b78cb req-88cf4331-b631-4ef9-97f9-cf874f04da0f service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-16f0017a-1d3b-426f-adeb-987a344b78cb req-88cf4331-b631-4ef9-97f9-cf874f04da0f service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-16f0017a-1d3b-426f-adeb-987a344b78cb req-88cf4331-b631-4ef9-97f9-cf874f04da0f service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-16f0017a-1d3b-426f-adeb-987a344b78cb req-88cf4331-b631-4ef9-97f9-cf874f04da0f service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-16f0017a-1d3b-426f-adeb-987a344b78cb req-88cf4331-b631-4ef9-97f9-cf874f04da0f service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-16f0017a-1d3b-426f-adeb-987a344b78cb req-88cf4331-b631-4ef9-97f9-cf874f04da0f service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23063393934303332', 'path': '/dev/sdh'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063393934303332', 'path': '/dev/sdh'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.893s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lazy-loading 'flavor' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630585a-d602-4f47-b57d-a7b54d14cab0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:00 user nova-compute[74934]: No targets found.
Nov 19 14:51:00 user nova-compute[74934]: iSNS:
Nov 19 14:51:00 user nova-compute[74934]: No targets found.
Nov 19 14:51:00 user nova-compute[74934]: STATIC:
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb
Nov 19 14:51:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:00 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:00 user nova-compute[74934]: No targets found.
Nov 19 14:51:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:00 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:00 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df0684-06f8-4571-baab-d5653bfa2e0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e9c23-9a7f-4e78-ac43-3d8d5137252e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:00 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4dc1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0'): ({'sdk'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Removing single pathed devices sdk {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eba25b-418b-40c2-bc49-719129208ea2]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[637080f7-3bc5-4f2a-b30e-74a5db5d2b55]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Flushing IO for device /dev/sdk {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e1a0f-d369-4504-84ca-1572c3caaad2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.052s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4457f34-83e4-4a91-b114-afd063a5e815]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] SCSI volumes sdk have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be072b6-d2c9-4467-a48f-e3163768d686]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:51:01 user nova-compute[74934]: INFO nova.compute.claims [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Claim successful on node user
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e47d43-45c0-4e0e-aa1c-dff73d8d3e40]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260]
Nov 19 14:51:01 user nova-compute[74934]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:01 user nova-compute[74934]: INFO nova.compute.manager [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Terminating instance
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19d61ce4-43f6-4db1-870d-e42d570aa8b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[10522bf1-c6bc-4ea9-99b0-cc0022ceab41]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.507s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] <== disconnect_volume: return (1401ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:01 user nova-compute[74934]: WARNING nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-53aee27f-edaa-4397-a44a-abe0e0df7af9 for instance with vm_state active and task_state deleting.
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:01 user nova-compute[74934]: WARNING nova.compute.manager [req-78c8a6d5-71a0-4892-b447-fe53bcd45cd5 req-576a447d-adca-4a88-896f-8c42f78ab3c5 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-d3502927-a1c4-4a60-aa48-0ad21c58eaad for instance with vm_state active and task_state deleting.
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:51:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:51:02 user nova-compute[74934]: INFO nova.virt.block_device [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Booting with blank volume at /dev/vda
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 75497472 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Instance destroyed successfully.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lazy-loading 'resources' on Instance uuid 0ae17df3-ca5b-432a-8975-7e94b549e19e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ded98a8-08, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-9ded98a8-0885-42aa-9a15-9601389e55b8 for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-8585d586-26ae-480e-b6f6-a0fc57b07350 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-8585d586-26ae-480e-b6f6-a0fc57b07350 for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-36df05dc-e208-4e98-a9e4-593fbf534073 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-36df05dc-e208-4e98-a9e4-593fbf534073 for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-78ae4f91-e884-439b-b889-06fa9de43dcf req-b397a0d3-0886-4dd5-a7c7-930ab8ac6ebd service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.policy [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08d75edb533b4dfca6e9785c439df050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5862e932d40a68f17b4e8bb77ef77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95ce5e77-cc5f-4056-9e44-64b00ac7d989) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-unplugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-unplugged-363ddf7b-3263-4367-9825-ea96fbc7c078 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] No waiting events found dispatching network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received unexpected event network-vif-plugged-363ddf7b-3263-4367-9825-ea96fbc7c078 for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-440e714d-4e02-4421-810f-891e5769473a for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-440e714d-4e02-4421-810f-891e5769473a for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:02 user nova-compute[74934]: WARNING nova.compute.manager [req-0fc1cdc1-9fef-4a6a-886f-32c3e7efa2ad req-903b64c2-c2d8-45a9-8d6d-d68aa3fd800e service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-31e81ef7-a125-4d8a-9adc-ace52dfcc5b3 for instance with vm_state active and task_state deleting.
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 111149056 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:de:ee,bridge_name='br-int',has_traffic_filtering=True,id=9ded98a8-0885-42aa-9a15-9601389e55b8,network=Network(9f996d03-1d8f-4406-83aa-732321e758d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ded98a8-08')
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53aee27f-ed, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 111149056 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39a389be-93cd-4968-8347-d3f109762466) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:03 user nova-compute[74934]: WARNING nova.compute.manager [req-a410f83e-a970-4d28-bb5d-dd927b6054fb req-83701cf1-61dd-4a3a-b221-8bcaca849b63 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-620aa04d-0566-4df8-8c9a-14d5c5eef099 for instance with vm_state active and task_state deleting.
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:03 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:93:6f,bridge_name='br-int',has_traffic_filtering=True,id=53aee27f-edaa-4397-a44a-abe0e0df7af9,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53aee27f-ed')
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8585d586-26, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Instance destroyed successfully.
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lazy-loading 'resources' on Instance uuid a5ed99bc-03bb-48f8-ab95-9c79adf3fe43 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "1a4a6bac-437f-425d-8bd1-3703b536e668", "address": "fa:16:3e:2b:62:e3", "network": {"id": "d3735b69-c13a-4411-9590-d2c54e95a9b0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-645900038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a4a6bac-43", "ovs_interfaceid": "1a4a6bac-437f-425d-8bd1-3703b536e668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'flavor' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7e6c5dc-d9dc-4980-9c39-52fc25a83244 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.831s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a4a6bac-43, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Successfully created port: d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 266338304 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "interface-b7614315-a839-4dbf-8137-9b4a096bea5b-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "interface-b7614315-a839-4dbf-8137-9b4a096bea5b-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebe1a091-fa73-48ce-a96b-e3079ab422d5) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'flavor' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface> {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface> {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Attempting to detach device tapa4c5c9bb-69 from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] detach device xml: <interface type="ethernet">
Nov 19 14:51:04 user nova-compute[74934]:   <mac address="fa:16:3e:5e:05:4d"/>
Nov 19 14:51:04 user nova-compute[74934]:   <model type="virtio"/>
Nov 19 14:51:04 user nova-compute[74934]:   <mtu size="1442"/>
Nov 19 14:51:04 user nova-compute[74934]:   <target dev="tapa4c5c9bb-69"/>
Nov 19 14:51:04 user nova-compute[74934]: </interface>
Nov 19 14:51:04 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface> {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 19 14:51:04 user nova-compute[74934]:   <name>instance-00000008</name>
Nov 19 14:51:04 user nova-compute[74934]:   <uuid>b7614315-a839-4dbf-8137-9b4a096bea5b</uuid>
Nov 19 14:51:04 user nova-compute[74934]:   <metadata>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:04 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:51:04 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:51:04 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:50:28</nova:creationTime>
Nov 19 14:51:04 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:51:04 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:04 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:51:04 user nova-compute[74934]:   <nova:owner>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:51:04 user nova-compute[74934]:   </nova:owner>
Nov 19 14:51:04 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:04 user nova-compute[74934]:   <nova:ports>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:51:04 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:04 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:04 user nova-compute[74934]:     <nova:port uuid="a4c5c9bb-69dc-4333-ae96-ae4bfe37f839">
Nov 19 14:51:04 user nova-compute[74934]:       <nova:ip type="fixed" address="10.10.10.203" ipVersion="4"/>
Nov 19 14:51:04 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:04 user nova-compute[74934]:   </nova:ports>
Nov 19 14:51:04 user nova-compute[74934]: </nova:instance>
Nov 19 14:51:04 user nova-compute[74934]:   </metadata>
Nov 19 14:51:04 user nova-compute[74934]:   <memory unit='KiB'>524288</memory>
Nov 19 14:51:04 user nova-compute[74934]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 19 14:51:04 user nova-compute[74934]:   <vcpu placement='static'>1</vcpu>
Nov 19 14:51:04 user nova-compute[74934]:   <resource>
Nov 19 14:51:04 user nova-compute[74934]:     <partition>/machine</partition>
Nov 19 14:51:04 user nova-compute[74934]:   </resource>
Nov 19 14:51:04 user nova-compute[74934]:   <sysinfo type='smbios'>
Nov 19 14:51:04 user nova-compute[74934]:     <system>
Nov 19 14:51:04 user nova-compute[74934]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 19 14:51:04 user nova-compute[74934]:       <entry name='product'>OpenStack Nova</entry>
Nov 19 14:51:04 user nova-compute[74934]:       <entry name='version'>0.0.0</entry>
Nov 19 14:51:04 user nova-compute[74934]:       <entry name='serial'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:04 user nova-compute[74934]:       <entry name='uuid'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:04 user nova-compute[74934]:       <entry name='family'>Virtual Machine</entry>
Nov 19 14:51:04 user nova-compute[74934]:     </system>
Nov 19 14:51:04 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:04 user nova-compute[74934]:   <os>
Nov 19 14:51:04 user nova-compute[74934]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 19 14:51:04 user nova-compute[74934]:     <boot dev='hd'/>
Nov 19 14:51:04 user nova-compute[74934]:     <smbios mode='sysinfo'/>
Nov 19 14:51:04 user nova-compute[74934]:   </os>
Nov 19 14:51:04 user nova-compute[74934]:   <features>
Nov 19 14:51:04 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:04 user nova-compute[74934]:     <apic/>
Nov 19 14:51:04 user nova-compute[74934]:     <vmcoreinfo state='on'/>
Nov 19 14:51:04 user nova-compute[74934]:   </features>
Nov 19 14:51:04 user nova-compute[74934]:   <cpu mode='custom' match='exact' check='full'>
Nov 19 14:51:04 user nova-compute[74934]:     <model fallback='forbid'>Nehalem</model>
Nov 19 14:51:04 user nova-compute[74934]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 19 14:51:04 user nova-compute[74934]:     <feature policy='require' name='vme'/>
Nov 19 14:51:04 user nova-compute[74934]:     <feature policy='require' name='x2apic'/>
Nov 19 14:51:04 user nova-compute[74934]:     <feature policy='require' name='hypervisor'/>
Nov 19 14:51:04 user nova-compute[74934]:   </cpu>
Nov 19 14:51:04 user nova-compute[74934]:   <clock offset='utc'>
Nov 19 14:51:04 user nova-compute[74934]:     <timer name='pit' tickpolicy='delay'/>
Nov 19 14:51:04 user nova-compute[74934]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 19 14:51:04 user nova-compute[74934]:     <timer name='hpet' present='no'/>
Nov 19 14:51:04 user nova-compute[74934]:   </clock>
Nov 19 14:51:04 user nova-compute[74934]:   <on_poweroff>destroy</on_poweroff>
Nov 19 14:51:04 user nova-compute[74934]:   <on_reboot>restart</on_reboot>
Nov 19 14:51:04 user nova-compute[74934]:   <on_crash>destroy</on_crash>
Nov 19 14:51:04 user nova-compute[74934]:   <devices>
Nov 19 14:51:04 user nova-compute[74934]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 19 14:51:04 user nova-compute[74934]:     <disk type='file' device='disk'>
Nov 19 14:51:04 user nova-compute[74934]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 19 14:51:04 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk' index='2'/>
Nov 19 14:51:04 user nova-compute[74934]:       <backingStore type='file' index='3'>
Nov 19 14:51:04 user nova-compute[74934]:         <format type='raw'/>
Nov 19 14:51:04 user nova-compute[74934]:         <source file='/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df'/>
Nov 19 14:51:04 user nova-compute[74934]:         <backingStore/>
Nov 19 14:51:04 user nova-compute[74934]:       </backingStore>
Nov 19 14:51:04 user nova-compute[74934]:       <target dev='vda' bus='virtio'/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='virtio-disk0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </disk>
Nov 19 14:51:04 user nova-compute[74934]:     <disk type='file' device='cdrom'>
Nov 19 14:51:04 user nova-compute[74934]:       <driver name='qemu' type='raw' cache='none'/>
Nov 19 14:51:04 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config' index='1'/>
Nov 19 14:51:04 user nova-compute[74934]:       <backingStore/>
Nov 19 14:51:04 user nova-compute[74934]:       <target dev='hda' bus='ide'/>
Nov 19 14:51:04 user nova-compute[74934]:       <readonly/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='ide0-0-0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </disk>
Nov 19 14:51:04 user nova-compute[74934]:     <controller type='usb' index='0' model='none'>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='usb'/>
Nov 19 14:51:04 user nova-compute[74934]:     </controller>
Nov 19 14:51:04 user nova-compute[74934]:     <controller type='pci' index='0' model='pci-root'>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='pci.0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </controller>
Nov 19 14:51:04 user nova-compute[74934]:     <controller type='ide' index='0'>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='ide'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 19 14:51:04 user nova-compute[74934]:     </controller>
Nov 19 14:51:04 user nova-compute[74934]:     <interface type='ethernet'>
Nov 19 14:51:04 user nova-compute[74934]:       <mac address='fa:16:3e:7d:a1:30'/>
Nov 19 14:51:04 user nova-compute[74934]:       <target dev='tap99f638f7-1e'/>
Nov 19 14:51:04 user nova-compute[74934]:       <model type='virtio'/>
Nov 19 14:51:04 user nova-compute[74934]:       <mtu size='1442'/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='net0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </interface>
Nov 19 14:51:04 user nova-compute[74934]:     <interface type='ethernet'>
Nov 19 14:51:04 user nova-compute[74934]:       <mac address='fa:16:3e:5e:05:4d'/>
Nov 19 14:51:04 user nova-compute[74934]:       <target dev='tapa4c5c9bb-69'/>
Nov 19 14:51:04 user nova-compute[74934]:       <model type='virtio'/>
Nov 19 14:51:04 user nova-compute[74934]:       <mtu size='1442'/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='net1'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </interface>
Nov 19 14:51:04 user nova-compute[74934]:     <serial type='pty'>
Nov 19 14:51:04 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:04 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:04 user nova-compute[74934]:       <target type='isa-serial' port='0'>
Nov 19 14:51:04 user nova-compute[74934]:         <model name='isa-serial'/>
Nov 19 14:51:04 user nova-compute[74934]:       </target>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </serial>
Nov 19 14:51:04 user nova-compute[74934]:     <console type='pty' tty='/dev/pts/7'>
Nov 19 14:51:04 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:04 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:04 user nova-compute[74934]:       <target type='serial' port='0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </console>
Nov 19 14:51:04 user nova-compute[74934]:     <input type='mouse' bus='ps2'>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='input0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </input>
Nov 19 14:51:04 user nova-compute[74934]:     <input type='keyboard' bus='ps2'>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='input1'/>
Nov 19 14:51:04 user nova-compute[74934]:     </input>
Nov 19 14:51:04 user nova-compute[74934]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 19 14:51:04 user nova-compute[74934]:       <listen type='address' address='0.0.0.0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </graphics>
Nov 19 14:51:04 user nova-compute[74934]:     <audio id='1' type='none'/>
Nov 19 14:51:04 user nova-compute[74934]:     <video>
Nov 19 14:51:04 user nova-compute[74934]:       <model type='virtio' heads='1' primary='yes'/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='video0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </video>
Nov 19 14:51:04 user nova-compute[74934]:     <memballoon model='virtio'>
Nov 19 14:51:04 user nova-compute[74934]:       <stats period='10'/>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='balloon0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:04 user nova-compute[74934]:     <rng model='virtio'>
Nov 19 14:51:04 user nova-compute[74934]:       <backend model='random'>/dev/urandom</backend>
Nov 19 14:51:04 user nova-compute[74934]:       <alias name='rng0'/>
Nov 19 14:51:04 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 19 14:51:04 user nova-compute[74934]:     </rng>
Nov 19 14:51:04 user nova-compute[74934]:   </devices>
Nov 19 14:51:04 user nova-compute[74934]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 19 14:51:04 user nova-compute[74934]:     <label>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</label>
Nov 19 14:51:04 user nova-compute[74934]:     <imagelabel>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</imagelabel>
Nov 19 14:51:04 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:04 user nova-compute[74934]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 19 14:51:04 user nova-compute[74934]:     <label>+64055:+108</label>
Nov 19 14:51:04 user nova-compute[74934]:     <imagelabel>+64055:+108</imagelabel>
Nov 19 14:51:04 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:04 user nova-compute[74934]: </domain>
Nov 19 14:51:04 user nova-compute[74934]:  {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 19 14:51:04 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully detached device tapa4c5c9bb-69 from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the persistent domain config.
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] (1/8): Attempting to detach device tapa4c5c9bb-69 with device alias net1 from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] detach device xml: <interface type="ethernet">
Nov 19 14:51:04 user nova-compute[74934]:   <mac address="fa:16:3e:5e:05:4d"/>
Nov 19 14:51:04 user nova-compute[74934]:   <model type="virtio"/>
Nov 19 14:51:04 user nova-compute[74934]:   <mtu size="1442"/>
Nov 19 14:51:04 user nova-compute[74934]:   <target dev="tapa4c5c9bb-69"/>
Nov 19 14:51:04 user nova-compute[74934]: </interface>
Nov 19 14:51:04 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56d91eda-bbf2-4ca5-bd0a-400ed31d1e91) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:04 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:ef,bridge_name='br-int',has_traffic_filtering=True,id=8585d586-26ae-480e-b6f6-a0fc57b07350,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8585d586-26')
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "address": "fa:16:3e:23:98:5e", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaeba2c8d-b7", "ovs_interfaceid": "aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: WARNING nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with vm_state active and task_state deleting.
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: WARNING nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-4eb5b190-be80-42cf-b92b-4ac2a56cf627 for instance with vm_state active and task_state deleting.
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: WARNING nova.compute.manager [req-4e5b1c9b-eb53-4154-b60a-31d55698ae4c req-427be1aa-b7f5-4b00-b73c-906c6fe3d3dc service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with vm_state active and task_state deleting.
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-a1992673-172b-4bcc-b293-cd0dc830f205 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: WARNING nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-a1992673-172b-4bcc-b293-cd0dc830f205 for instance with vm_state active and task_state deleting.
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-02af2d15-9e76-438c-b4da-141a0fa771ca for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:04 user nova-compute[74934]: WARNING nova.compute.manager [req-f317a025-83bf-49d9-b2bd-32c665dae4d3 req-64d0a5e2-0387-4a44-ac92-fa8432975ba1 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-02af2d15-9e76-438c-b4da-141a0fa771ca for instance with vm_state active and task_state deleting.
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaeba2c8d-b7, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:04 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:62:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a4a6bac-437f-425d-8bd1-3703b536e668,network=Network(d3735b69-c13a-4411-9590-d2c54e95a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a4a6bac-43')
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 438304768 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap440e714d-4e, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Start waiting for the detach event from libvirt for device tapa4c5c9bb-69 with device alias net1 for instance b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:51:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6980881e-6176-4958-989f-ec1ac8131c56) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 599785472 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8b186e0-4664-4e9d-a70e-49ea0aa8d121) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaeba2c8d-b7')
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Successfully updated port: d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap363ddf7b-32, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:81:b6,bridge_name='br-int',has_traffic_filtering=True,id=440e714d-4e02-4421-810f-891e5769473a,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap440e714d-4e')
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31e81ef7-a1, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 776994816 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c85bd0c1-7cab-4300-a357-cd89c1cb0b30) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 is timed out.
Nov 19 14:51:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Successfully detached device vdb from instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 from the live domain config.
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lCXzRBcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:05 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating instance_info_cache with network_info: [{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=273b8958-122e-4af5-87f2-7b9728a778c5) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfc2d15-770e-4cbf-b161-107b3e53d794]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:05 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:37:ed,bridge_name='br-int',has_traffic_filtering=True,id=363ddf7b-3263-4367-9825-ea96fbc7c078,network=Network(e9f7f706-9529-4259-ab1b-2595eb07cc5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363ddf7b-32')
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:05 user nova-compute[74934]: No targets found.
Nov 19 14:51:05 user nova-compute[74934]: iSNS:
Nov 19 14:51:05 user nova-compute[74934]: No targets found.
Nov 19 14:51:05 user nova-compute[74934]: STATIC:
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb
Nov 19 14:51:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:05 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:05 user nova-compute[74934]: No targets found.
Nov 19 14:51:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:05 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:05 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance network_info: |[{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2723f5e-61f6-40e9-84f3-482ac73a3cbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3502927-a1, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:05 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:8c:5b,bridge_name='br-int',has_traffic_filtering=True,id=31e81ef7-a125-4d8a-9adc-ace52dfcc5b3,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap31e81ef7-a1')
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d66ef96-2e57-4998-94a3-aaf321192719]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:05 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6'): ({'sdl'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Removing single pathed devices sdl {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b3379-090c-4d9b-9ae3-e21c60010610]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a5fa1b-3bdd-4d31-808c-346335123385]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1992673-17, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Flushing IO for device /dev/sdl {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65d93e-c30f-4ee5-93a9-3b829971590c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64e8dfb8-8330-4b7d-9757-800dba1ee274) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd1b7f1-a345-4eb1-9d2e-145714e2d0e2]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] SCSI volumes sdl have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc7093-22ab-4dcb-9de0-fe73a0e7f614]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c518be8e-c4ae-4828-88f6-a5fc3c5e947c) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:80:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3502927-a1c4-4a60-aa48-0ad21c58eaad,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3502927-a1')
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1839427589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1839427589',id=12,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe35BY9ytBDIAUNSjHmRVjaozx/SahG0fy2Z8mGiSSP/tDf8N9yly5BB4V4IQd+9SfnyFkAOSROBrt8scp5Q8VKqC/wjFm8YlcBbplkxA8zYgd+MfTTTSps25kibwRdSg==',key_name='tempest-keypair-109686840',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120a65aa7a6240b48adf7b7f8c76c8a6',ramdisk_id='',reservation_id='r-amfbb5oz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1954019468',owner_user_name='tempest-TaggedBootDevicesTest-1954019468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66a341a079864dfca3bf3648612bc39e',uuid=0ae17df3-ca5b-432a-8975-7e94b549e19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converting VIF {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36df05dc-e2, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:5a,bridge_name='br-int',has_traffic_filtering=True,id=a1992673-172b-4bcc-b293-cd0dc830f205,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1992673-17')
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c1836-42c1-46d1-a9f7-21c3fc85e13a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260]
Nov 19 14:51:06 user nova-compute[74934]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eb5b190-be, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221e4d17-4381-49da-9c16-5c47079cd5b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d380c7-c8ef-4048-815c-160d2da96bc7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] <== disconnect_volume: return (447ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea1a52d3-f5c9-4603-ad06-ba1399ba095a) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 946864128 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da01d379-a741-4c7e-8690-eccbf19d161b) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: INFO os_vif [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:2f:b0,bridge_name='br-int',has_traffic_filtering=True,id=36df05dc-e208-4e98-a9e4-593fbf534073,network=Network(848e3e13-69ff-495d-97ad-19bb4173b03d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36df05dc-e2')
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOapjXFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:02:9d,bridge_name='br-int',has_traffic_filtering=True,id=4eb5b190-be80-42cf-b92b-4ac2a56cf627,network=Network(1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eb5b190-be')
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02af2d15-9e, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cf4b6-8a65-4874-a37c-58ddcd45dec3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:06 user nova-compute[74934]: No targets found.
Nov 19 14:51:06 user nova-compute[74934]: iSNS:
Nov 19 14:51:06 user nova-compute[74934]: No targets found.
Nov 19 14:51:06 user nova-compute[74934]: STATIC:
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:06 user nova-compute[74934]: No targets found.
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:06 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:06 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28ba3740-46aa-4d54-9671-8660219e2ca3) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc4775-5868-4844-8458-ff1c1d37382f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:51:79,bridge_name='br-int',has_traffic_filtering=True,id=02af2d15-9e76-438c-b4da-141a0fa771ca,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02af2d15-9e')
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:49:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1564852900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1564852900',id=13,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAc+EEFzVAeJumqCPNtHaIaPQgJZxG5R9BqALrDIh7HzXMHw2HAT0W4Ac3PW0BEsfXcNmyEbK85gudYVxEpO2dfDkWPoJbeQMxbQN7n3oBYtVHQBltgP/cIRYHSXSdZB3Q==',key_name='tempest-keypair-1293785883',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62a01e157ea24e1fa6dd189e26aad897',ramdisk_id='',reservation_id='r-6brhe0pn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2013958253',owner_user_name='tempest-TaggedBootDevicesTest_v242-2013958253-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2967d573604485b044645974acb084',uuid=a5ed99bc-03bb-48f8-ab95-9c79adf3fe43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converting VIF {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap620aa04d-05, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d984e0b9-0f35-4c18-bfef-7c97fb157cc7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc291fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d24ced60-826d-4fad-9fc4-50e702dbe16a) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:06 user nova-compute[74934]: INFO os_vif [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:51:e7,bridge_name='br-int',has_traffic_filtering=True,id=620aa04d-0566-4df8-8c9a-14d5c5eef099,network=Network(6a76f6b3-0580-485e-8cfd-36ef10b5e1b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620aa04d-05')
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b27ee2-48c9-4133-9faf-896cbc6cfd72]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWpjQvTJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b0630c-89d7-4056-ba8c-6ebffdd623da]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab28d51-82d9-4708-9e47-2fd6f01eb2dd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb38a4e-6f6f-4689-b7b6-aa42c0d1f4f8]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d562a358-7348-4fb0-bdf1-43aeada1c3c9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with vm_state active and task_state deleting.
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-unplugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-unplugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Acquiring lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] No waiting events found dispatching network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received unexpected event network-vif-plugged-1a4a6bac-437f-425d-8bd1-3703b536e668 for instance with vm_state active and task_state deleting.
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-changed-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Refreshing instance network info cache due to event network-changed-d5401bfd-dacc-4573-b48f-16f6cac437e6. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Acquiring lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Acquired lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.network.neutron [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Refreshing network info cache for port d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f4f23-4c5e-4ccc-b6d6-d0152a9072a0]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260]
Nov 19 14:51:06 user nova-compute[74934]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-unplugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-unplugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING nova.compute.manager [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-unplugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 for instance with vm_state active and task_state None.
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING nova.compute.manager [req-e9fe32f7-1891-4c80-8354-04735dc5a254 req-0d6148d2-2ba6-47db-b8d3-56ed10b13fb4 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-plugged-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 for instance with vm_state active and task_state None.
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33f1fce9-2d60-42ff-80e8-fd18c7bc03eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1d9640-ccfe-4174-9c74-c532def10563]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== disconnect_volume: return (433ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.266s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCjGiWIQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac359f7-a4d7-4e17-b33a-7f7c167cd8d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:06 user nova-compute[74934]: No targets found.
Nov 19 14:51:06 user nova-compute[74934]: iSNS:
Nov 19 14:51:06 user nova-compute[74934]: No targets found.
Nov 19 14:51:06 user nova-compute[74934]: STATIC:
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:06 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:06 user nova-compute[74934]: No targets found.
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:06 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:06 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b93980b-6686-4fed-b29c-5762c0357c78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec90864-702f-48da-96a9-767e23c211c4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:06 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e8d29900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[acde9c68-965e-4892-8433-f967b1fc47de]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8657524-ec9c-4ebf-a204-2c24c2b75bd8]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a00557b-fefb-4da6-93ce-9165aaeec97f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMwPzQUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'a42acc34-16eb-4753-a910-2c9dafb3e7be'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed0a7a1-cfc1-43a0-a31c-5078001a2e28]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d2143-2bcc-4648-9fd5-b4789a03d826]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.network.neutron [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updated VIF entry in instance network info cache for port d5401bfd-dacc-4573-b48f-16f6cac437e6. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.network.neutron [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating instance_info_cache with network_info: [{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c1aa583-b98c-4a52-9fd4-28add6897c09 req-aeecb0b9-7321-40ab-8158-54337c80385d service nova] Releasing lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05814fe-c01c-47f9-acb6-fab3df6cd44c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260]
Nov 19 14:51:07 user nova-compute[74934]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bbbe24-64d5-46c7-8f55-739be2de4fe3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d476fb-02c4-4c6e-a8ba-bf371695c0c7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== disconnect_volume: return (602ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.335s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wBesMUSV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:07 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a95c1-1576-4173-af37-e31d19223991]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]: iSNS:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]: STATIC:
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:07 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:07 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deb4e7f-d517-4e0e-96d3-fc9f2913536e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a3063f-e25b-4920-b665-47df2cea08f2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce'): ({'sde'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Removing single pathed devices sde {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7d6492-726b-4d48-8685-aa7cb669f2dd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04f9fd2-ee16-4231-8679-33da2f094bf5]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Flushing IO for device /dev/sde {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[30555844-1a01-47ba-b99c-145e2f413cc4]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9ed023-75bf-4d27-92f9-0dc671111c69]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lazy-loading 'flavor' on Instance uuid bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5d40d0-3e98-4adb-bbd8-472b2efca01a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9189fd18-e8a4-4275-97a6-9792b371b18c tempest-VolumesAssistedSnapshotsTest-1281520259 tempest-VolumesAssistedSnapshotsTest-1281520259-project-admin] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.041s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ef39f0-5c90-4a48-bda5-a01d4574f919]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260]
Nov 19 14:51:07 user nova-compute[74934]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4098aa71-7717-4be5-bbb9-597216910dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ebdf62-9259-40fb-b20f-96139c6746e6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== disconnect_volume: return (652ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.499s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZXBbNPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:07 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e826e0-60af-4aac-8099-e77ab2960114]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]: iSNS:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]: STATIC:
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:07 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:07 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae5c7c-d447-4467-9159-1ffbf6478244]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c8b60-e36d-48ed-9a8c-04df2c637d83]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4422440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be'): ({'sdm'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Removing single pathed devices sdm {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48bbf88-93fe-493d-a223-e7919a6b9ea8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f65daf-29cf-48d8-9af6-79bc0d814824]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Flushing IO for device /dev/sdm {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a711c03-f2a9-484e-bcc3-e1135e651deb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f1e1f-a34b-4a36-8473-4bb0e23c08e8]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] SCSI volumes sdm have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4383f339-1368-4c8f-815f-8282d383a934]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[354d3c8e-c411-4e89-94ab-6049b2f3f806]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260]
Nov 19 14:51:07 user nova-compute[74934]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42acc34-16eb-4753-a910-2c9dafb3e7be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e8831-6454-4bf4-bbbe-3759f7326e3f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] <== disconnect_volume: return (785ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.605s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e3cdd-5355-47d3-974c-4ae05e86316b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]: iSNS:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]: STATIC:
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:07 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:07 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:07 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:07 user nova-compute[74934]: No targets found.
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:07 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:07 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40edd6-72cf-4cd4-841a-c9f6f5bc112f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '60dddb96-ee81-4cc8-8960-7e0189d4543b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd40ecd8e-7930-420d-aab7-a745c6222a9b', 'serial'} {{(pid=74934) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] swap_volume: removing Cinder connection for volume a42acc34-16eb-4753-a910-2c9dafb3e7be {{(pid=74934) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f7e2bb-1083-4a9e-9be9-71d8d1d05bae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:07 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4422440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e798a7-edba-4674-9980-53735530eef6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[71680cfb-782f-4695-91e6-007b3374e75d]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fdc8f4-8194-4137-8b58-45196e1d854b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d10bf-4e71-43d8-83c8-bb46e899f901]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05064b-0b42-4282-98b0-5d88598c5e77]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG os_brick.utils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ad544-fd7a-46e9-b3f2-39ddd5449fc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[083fb743-b271-43e4-b43e-e8fd256ad15a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b91c2-a83e-430e-a2ea-a751f67a2cbe]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260]
Nov 19 14:51:08 user nova-compute[74934]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b41fe6-5d79-4d7d-9558-328ba6707edc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab664ae-c709-474b-849f-7cc3584e69ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9019cdf-28d1-41c8-a295-dddb49bae5da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fec800-0f15-4891-a8be-f53da093c505]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== disconnect_volume: return (924ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.609s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKTvkiUI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:08 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:51:08 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951b7c6-905d-4acb-abe9-4d2a20fae73d]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating existing volume attachment record: 909af401-c2b2-4045-9806-4050779df4ff {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4122426-00cc-45c4-a771-e73e5fe99a80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:08 user nova-compute[74934]: No targets found.
Nov 19 14:51:08 user nova-compute[74934]: iSNS:
Nov 19 14:51:08 user nova-compute[74934]: No targets found.
Nov 19 14:51:08 user nova-compute[74934]: STATIC:
Nov 19 14:51:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25
Nov 19 14:51:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:08 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:08 user nova-compute[74934]: No targets found.
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:08 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:08 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd482112-5bb8-4d7c-80c1-416f5d19db68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa84e27-c734-4589-bd9c-0841921084c3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:08 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:08 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:08 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:08 user nova-compute[74934]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 (non-flash)
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4422200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25'): ({'sdg'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Removing single pathed devices sdg {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[467d8d90-5456-496e-966e-ab476371c808]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbbe634-cfa7-4e37-a624-84b7c2d1fa94]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Flushing IO for device /dev/sdg {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8661628-a691-45c6-a759-cb86b58fb190]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa9745-1894-4b97-938d-00fcdc8ef463]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ef572-5fc1-4452-bc96-caa2a6da0a52]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.140s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe89786-37b8-47d6-8db7-7bd39dbd9b23]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260]
Nov 19 14:51:08 user nova-compute[74934]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ade7d41-4451-4074-b7f1-475bdc22dc25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d194e2-ab42-4f67-a413-82117119e8ac]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] <== disconnect_volume: return (1013ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Deleting instance files /opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e_del
Nov 19 14:51:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Deletion of /opt/stack/data/nova/instances/0ae17df3-ca5b-432a-8975-7e94b549e19e_del complete
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.410s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[324527f8-dc0d-4f97-9d17-9e6bd89e6758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:08 user nova-compute[74934]: No targets found.
Nov 19 14:51:08 user nova-compute[74934]: iSNS:
Nov 19 14:51:08 user nova-compute[74934]: No targets found.
Nov 19 14:51:08 user nova-compute[74934]: STATIC:
Nov 19 14:51:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a
Nov 19 14:51:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:08 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:08 user nova-compute[74934]: No targets found.
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:08 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:08 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8d59e5-b078-4d0f-b770-e6bb9b8ef77c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4096ea19-56ba-46f3-853b-572554f77346]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:08 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:08 user nova-compute[74934]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a (non-flash)
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c45be9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a'): ({'sdf'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Removing single pathed devices sdf {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:08 user nova-compute[74934]: INFO nova.compute.manager [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Took 8.74 seconds to destroy the instance on the hypervisor.
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa0b1bb-44b2-4429-ac16-f7361467550f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] swap_volume: Updating volume a42acc34-16eb-4753-a910-2c9dafb3e7be BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MfaGpDlL", "auth_password": "rCgNQ37M0E6hm5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "d40ecd8e-7930-420d-aab7-a745c6222a9b"}, "status": "reserved", "instance": "60dddb96-ee81-4cc8-8960-7e0189d4543b", "attached_at": "", "detached_at": "", "volume_id": "d40ecd8e-7930-420d-aab7-a745c6222a9b", "serial": "d40ecd8e-7930-420d-aab7-a745c6222a9b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd40ecd8e-7930-420d-aab7-a745c6222a9b', 'no_device': None, 'attachment_id': '58c6c58c-5db7-4b1d-8345-f08feea6ea55'} {{(pid=74934) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a6bdba-35af-49f2-a797-4644cef97927]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Flushing IO for device /dev/sdf {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3872eedb-5d83-4eb2-ab55-2a1785bd04f4 tempest-TestVolumeSwap-206558401 tempest-TestVolumeSwap-206558401-project-admin] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.636s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24286ba2-8fb1-499d-a8b8-b832aee94245]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e09bb52-975b-438f-9eaa-311adc384db2]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaca6d3-f38b-440c-a482-94b135e7c9ab]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0329b0ef-d38d-40ce-922f-69d22d87d884]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260]
Nov 19 14:51:08 user nova-compute[74934]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af782e66-5706-40c1-b1ef-bba5b6dfaa4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c129d0a-cdcb-459c-a41c-173bd39af070]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] <== disconnect_volume: return (738ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Deleting instance files /opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43_del
Nov 19 14:51:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Deletion of /opt/stack/data/nova/instances/a5ed99bc-03bb-48f8-ab95-9c79adf3fe43_del complete
Nov 19 14:51:08 user nova-compute[74934]: INFO nova.compute.manager [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Took 7.67 seconds to destroy the instance on the hypervisor.
Nov 19 14:51:08 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:51:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:51:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:09 user nova-compute[74934]: INFO nova.compute.manager [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Detaching volume d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:09 user nova-compute[74934]: INFO nova.virt.block_device [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Attempting to driver detach volume d40ecd8e-7930-420d-aab7-a745c6222a9b from mountpoint /dev/vdb
Nov 19 14:51:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Attempting to detach device vdb from instance 60dddb96-ee81-4cc8-8960-7e0189d4543b from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:51:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:51:09 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:51:09 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 14:51:09 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:51:09 user nova-compute[74934]:   <serial>d40ecd8e-7930-420d-aab7-a745c6222a9b</serial>
Nov 19 14:51:09 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:51:09 user nova-compute[74934]: </disk>
Nov 19 14:51:09 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:51:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Successfully detached device vdb from instance 60dddb96-ee81-4cc8-8960-7e0189d4543b from the persistent domain config.
Nov 19 14:51:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60dddb96-ee81-4cc8-8960-7e0189d4543b from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:51:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:51:09 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:51:09 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 14:51:09 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:51:09 user nova-compute[74934]:   <serial>d40ecd8e-7930-420d-aab7-a745c6222a9b</serial>
Nov 19 14:51:09 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:51:09 user nova-compute[74934]: </disk>
Nov 19 14:51:09 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:51:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:51:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-25a455c5-ab05-4f8e-be4d-3212ddc37f62 req-8f12e0cd-8609-4efc-bab0-6ee508b250ba service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-deleted-aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:10 user nova-compute[74934]: INFO nova.compute.manager [req-25a455c5-ab05-4f8e-be4d-3212ddc37f62 req-8f12e0cd-8609-4efc-bab0-6ee508b250ba service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Neutron deleted interface aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670; detaching it from the instance and deleting it from the info cache
Nov 19 14:51:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-25a455c5-ab05-4f8e-be4d-3212ddc37f62 req-8f12e0cd-8609-4efc-bab0-6ee508b250ba service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [{"id": "9ded98a8-0885-42aa-9a15-9601389e55b8", "address": "fa:16:3e:23:de:ee", "network": {"id": "9f996d03-1d8f-4406-83aa-732321e758d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-887281850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ded98a8-08", "ovs_interfaceid": "9ded98a8-0885-42aa-9a15-9601389e55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "address": "fa:16:3e:9f:93:6f", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53aee27f-ed", "ovs_interfaceid": "53aee27f-edaa-4397-a44a-abe0e0df7af9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8585d586-26ae-480e-b6f6-a0fc57b07350", "address": "fa:16:3e:a7:e0:ef", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8585d586-26", "ovs_interfaceid": "8585d586-26ae-480e-b6f6-a0fc57b07350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "363ddf7b-3263-4367-9825-ea96fbc7c078", "address": "fa:16:3e:37:37:ed", "network": {"id": "e9f7f706-9529-4259-ab1b-2595eb07cc5c", "bridge": "br-int", "label": "tempest-device-tagging-net1-340429047", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363ddf7b-32", "ovs_interfaceid": "363ddf7b-3263-4367-9825-ea96fbc7c078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "address": "fa:16:3e:24:80:8b", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3502927-a1", "ovs_interfaceid": "d3502927-a1c4-4a60-aa48-0ad21c58eaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "36df05dc-e208-4e98-a9e4-593fbf534073", "address": "fa:16:3e:ca:2f:b0", "network": {"id": "848e3e13-69ff-495d-97ad-19bb4173b03d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568776947", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "120a65aa7a6240b48adf7b7f8c76c8a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36df05dc-e2", "ovs_interfaceid": "36df05dc-e208-4e98-a9e4-593fbf534073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-25a455c5-ab05-4f8e-be4d-3212ddc37f62 req-8f12e0cd-8609-4efc-bab0-6ee508b250ba service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Detach interface failed, port_id=aeba2c8d-b7c7-40aa-9bb7-62d0c12ac670, reason: Instance 0ae17df3-ca5b-432a-8975-7e94b549e19e could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:51:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-9254021a-ae0f-434c-a705-38ad6b680124 req-c4f3da44-f0e0-4d60-8e9d-22dcd5deece3 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-deleted-1a4a6bac-437f-425d-8bd1-3703b536e668 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:11 user nova-compute[74934]: INFO nova.compute.manager [req-9254021a-ae0f-434c-a705-38ad6b680124 req-c4f3da44-f0e0-4d60-8e9d-22dcd5deece3 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Neutron deleted interface 1a4a6bac-437f-425d-8bd1-3703b536e668; detaching it from the instance and deleting it from the info cache
Nov 19 14:51:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-9254021a-ae0f-434c-a705-38ad6b680124 req-c4f3da44-f0e0-4d60-8e9d-22dcd5deece3 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [{"id": "440e714d-4e02-4421-810f-891e5769473a", "address": "fa:16:3e:7f:81:b6", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440e714d-4e", "ovs_interfaceid": "440e714d-4e02-4421-810f-891e5769473a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "address": "fa:16:3e:3a:8c:5b", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e81ef7-a1", "ovs_interfaceid": "31e81ef7-a125-4d8a-9adc-ace52dfcc5b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1992673-172b-4bcc-b293-cd0dc830f205", "address": "fa:16:3e:e4:e1:5a", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1992673-17", "ovs_interfaceid": "a1992673-172b-4bcc-b293-cd0dc830f205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "address": "fa:16:3e:b7:02:9d", "network": {"id": "1e07b0ad-52cb-4c3b-b6b6-8de0708d03e6", "bridge": "br-int", "label": "tempest-device-tagging-net1-869665943", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eb5b190-be", "ovs_interfaceid": "4eb5b190-be80-42cf-b92b-4ac2a56cf627", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "02af2d15-9e76-438c-b4da-141a0fa771ca", "address": "fa:16:3e:14:51:79", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02af2d15-9e", "ovs_interfaceid": "02af2d15-9e76-438c-b4da-141a0fa771ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "address": "fa:16:3e:ff:51:e7", "network": {"id": "6a76f6b3-0580-485e-8cfd-36ef10b5e1b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-332418337", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62a01e157ea24e1fa6dd189e26aad897", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620aa04d-05", "ovs_interfaceid": "620aa04d-0566-4df8-8c9a-14d5c5eef099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-9254021a-ae0f-434c-a705-38ad6b680124 req-c4f3da44-f0e0-4d60-8e9d-22dcd5deece3 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Detach interface failed, port_id=1a4a6bac-437f-425d-8bd1-3703b536e668, reason: Instance a5ed99bc-03bb-48f8-ab95-9c79adf3fe43 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:51:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:12 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Took 3.41 seconds to deallocate network for instance.
Nov 19 14:51:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-a0a11b8a-e066-4726-b429-1b4d27108fd4 req-39ce7179-811a-4d0e-b509-67240e5d0c69 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-deleted-d3502927-a1c4-4a60-aa48-0ad21c58eaad {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-a0a11b8a-e066-4726-b429-1b4d27108fd4 req-39ce7179-811a-4d0e-b509-67240e5d0c69 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-deleted-9ded98a8-0885-42aa-9a15-9601389e55b8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-a0a11b8a-e066-4726-b429-1b4d27108fd4 req-39ce7179-811a-4d0e-b509-67240e5d0c69 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-deleted-363ddf7b-3263-4367-9825-ea96fbc7c078 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-a0a11b8a-e066-4726-b429-1b4d27108fd4 req-39ce7179-811a-4d0e-b509-67240e5d0c69 service nova] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Received event network-vif-deleted-36df05dc-e208-4e98-a9e4-593fbf534073 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:12 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:13 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Took 4.14 seconds to deallocate network for instance.
Nov 19 14:51:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-f20b3457-7e74-4eaf-a4e6-4b21bef161ba req-3aa1bd7e-1168-45e0-93d1-dd38fb185ed8 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-deleted-4eb5b190-be80-42cf-b92b-4ac2a56cf627 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-f20b3457-7e74-4eaf-a4e6-4b21bef161ba req-3aa1bd7e-1168-45e0-93d1-dd38fb185ed8 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-deleted-620aa04d-0566-4df8-8c9a-14d5c5eef099 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-f20b3457-7e74-4eaf-a4e6-4b21bef161ba req-3aa1bd7e-1168-45e0-93d1-dd38fb185ed8 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-deleted-a1992673-172b-4bcc-b293-cd0dc830f205 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-f20b3457-7e74-4eaf-a4e6-4b21bef161ba req-3aa1bd7e-1168-45e0-93d1-dd38fb185ed8 service nova] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Received event network-vif-deleted-02af2d15-9e76-438c-b4da-141a0fa771ca {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:14 user nova-compute[74934]: INFO nova.compute.manager [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] [instance: 0ae17df3-ca5b-432a-8975-7e94b549e19e] Took 2.25 seconds to detach 3 volumes for instance.
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:51:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Creating image(s)
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Ensure instance console log exists: /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Start _get_guest_xml network_info=[{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '909af401-c2b2-4045-9806-4050779df4ff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1546e24-c8ba-40b9-81f9-084ab10c9a31', 'attached_at': '', 'detached_at': '', 'volume_id': '209acf5b-0510-43d2-b195-0e2b368807dc', 'serial': '209acf5b-0510-43d2-b195-0e2b368807dc'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:51:14 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:14 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:14 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:14 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:14 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70c5a57-5ed6-42f5-a890-cf965c8e145e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:51:14 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[528c4823-ffdf-445b-8e71-47ab57a08e38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc] added
Nov 19 14:51:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4219d58-8375-4a8a-8977-d8deb77e6742]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba773b46-14f3-4b84-8b58-1839bf9513d1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOlRnrVQ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOlRnrVQ" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dc8674-2010-4c32-8377-6d33c13d6820]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOlRnrVQ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e9835-b3a2-4bb3-ab24-9a559dd14bc9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8352f370-af7e-41e4-9ccf-6dca4e4d1aa0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1083578a-9d76-4f31-a863-97954f442978]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260]
Nov 19 14:51:14 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07df072-68e2-49bb-9d2f-d3378ff0c3be]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a528b6-e76a-4a5c-91d1-569ceea6fe28]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:14 user nova-compute[74934]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:51:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:14 user nova-compute[74934]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:51:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3267c86-a107-43be-82ef-f90cc7a7d1f2]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:51:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:51:14 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Deleted allocations for instance 0ae17df3-ca5b-432a-8975-7e94b549e19e
Nov 19 14:51:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2c38a4d7-89eb-4d95-9039-489970303343 tempest-TaggedBootDevicesTest-1954019468 tempest-TaggedBootDevicesTest-1954019468-project-member] Lock "0ae17df3-ca5b-432a-8975-7e94b549e19e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.078s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:15 user nova-compute[74934]: INFO nova.compute.manager [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] [instance: a5ed99bc-03bb-48f8-ab95-9c79adf3fe43] Took 2.21 seconds to detach 3 volumes for instance.
Nov 19 14:51:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:15 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Deleted allocations for instance a5ed99bc-03bb-48f8-ab95-9c79adf3fe43
Nov 19 14:51:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f191253-2e1e-4630-9783-ca4f657d3285 tempest-TaggedBootDevicesTest_v242-2013958253 tempest-TaggedBootDevicesTest_v242-2013958253-project-member] Lock "a5ed99bc-03bb-48f8-ab95-9c79adf3fe43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.521s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26535393261313334', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535393261313334', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1820545125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1820545125',id=14,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-229itr1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:02Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=f1546e24-c8ba-40b9-81f9-084ab10c9a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'pci_devices' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:51:15 user nova-compute[74934]:   <uuid>f1546e24-c8ba-40b9-81f9-084ab10c9a31</uuid>
Nov 19 14:51:15 user nova-compute[74934]:   <name>instance-0000000e</name>
Nov 19 14:51:15 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:51:15 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:51:15 user nova-compute[74934]:   <metadata>
Nov 19 14:51:15 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:15 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:51:15 user nova-compute[74934]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1820545125</nova:name>
Nov 19 14:51:15 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:51:14</nova:creationTime>
Nov 19 14:51:15 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:51:15 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:15 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:51:15 user nova-compute[74934]:       <nova:owner>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:user uuid="08d75edb533b4dfca6e9785c439df050">tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member</nova:user>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:project uuid="0da5862e932d40a68f17b4e8bb77ef77">tempest-ServerBootFromVolumeStableRescueTest-1047020547</nova:project>
Nov 19 14:51:15 user nova-compute[74934]:       </nova:owner>
Nov 19 14:51:15 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:15 user nova-compute[74934]:       <nova:ports>
Nov 19 14:51:15 user nova-compute[74934]:         <nova:port uuid="d5401bfd-dacc-4573-b48f-16f6cac437e6">
Nov 19 14:51:15 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:51:15 user nova-compute[74934]:         </nova:port>
Nov 19 14:51:15 user nova-compute[74934]:       </nova:ports>
Nov 19 14:51:15 user nova-compute[74934]:     </nova:instance>
Nov 19 14:51:15 user nova-compute[74934]:   </metadata>
Nov 19 14:51:15 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:51:15 user nova-compute[74934]:     <system>
Nov 19 14:51:15 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:51:15 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:51:15 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:51:15 user nova-compute[74934]:       <entry name="serial">f1546e24-c8ba-40b9-81f9-084ab10c9a31</entry>
Nov 19 14:51:15 user nova-compute[74934]:       <entry name="uuid">f1546e24-c8ba-40b9-81f9-084ab10c9a31</entry>
Nov 19 14:51:15 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:51:15 user nova-compute[74934]:     </system>
Nov 19 14:51:15 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:15 user nova-compute[74934]:   <os>
Nov 19 14:51:15 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:51:15 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:51:15 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:51:15 user nova-compute[74934]:   </os>
Nov 19 14:51:15 user nova-compute[74934]:   <features>
Nov 19 14:51:15 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:15 user nova-compute[74934]:     <apic/>
Nov 19 14:51:15 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:51:15 user nova-compute[74934]:   </features>
Nov 19 14:51:15 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:51:15 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:51:15 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:51:15 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:51:15 user nova-compute[74934]:   </clock>
Nov 19 14:51:15 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:51:15 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:51:15 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:51:15 user nova-compute[74934]:   </cpu>
Nov 19 14:51:15 user nova-compute[74934]:   <devices>
Nov 19 14:51:15 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:51:15 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:51:15 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 14:51:15 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:51:15 user nova-compute[74934]:       <serial>209acf5b-0510-43d2-b195-0e2b368807dc</serial>
Nov 19 14:51:15 user nova-compute[74934]:     </disk>
Nov 19 14:51:15 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:51:15 user nova-compute[74934]:       <mac address="fa:16:3e:99:bf:09"/>
Nov 19 14:51:15 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:51:15 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:51:15 user nova-compute[74934]:       <target dev="tapd5401bfd-da"/>
Nov 19 14:51:15 user nova-compute[74934]:     </interface>
Nov 19 14:51:15 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:51:15 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/console.log" append="off"/>
Nov 19 14:51:15 user nova-compute[74934]:     </serial>
Nov 19 14:51:15 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:51:15 user nova-compute[74934]:     <video>
Nov 19 14:51:15 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:51:15 user nova-compute[74934]:     </video>
Nov 19 14:51:15 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:51:15 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:51:15 user nova-compute[74934]:     </rng>
Nov 19 14:51:15 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:51:15 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:51:15 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:51:15 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:15 user nova-compute[74934]:   </devices>
Nov 19 14:51:15 user nova-compute[74934]: </domain>
Nov 19 14:51:15 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1820545125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1820545125',id=14,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-229itr1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:02Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=f1546e24-c8ba-40b9-81f9-084ab10c9a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG os_vif [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebeb10b7-ff2e-5c1e-a67a-ac4ecc0c34a7', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5401bfd-da, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5401bfd-da, col_values=(('qos', UUID('1a955f97-9787-47a8-92eb-65ecf6ad9eed')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5401bfd-da, col_values=(('external_ids', {'iface-id': 'd5401bfd-dacc-4573-b48f-16f6cac437e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:bf:09', 'vm-uuid': 'f1546e24-c8ba-40b9-81f9-084ab10c9a31'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:15 user nova-compute[74934]: INFO os_vif [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da')
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:51:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No VIF found with MAC fa:16:3e:99:bf:09, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-3b2a694f-907b-46ea-bcc6-8b80ab5456ed req-6fb594ec-aca4-4bc0-b46f-9b5dd68ec303 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3b2a694f-907b-46ea-bcc6-8b80ab5456ed req-6fb594ec-aca4-4bc0-b46f-9b5dd68ec303 service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3b2a694f-907b-46ea-bcc6-8b80ab5456ed req-6fb594ec-aca4-4bc0-b46f-9b5dd68ec303 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3b2a694f-907b-46ea-bcc6-8b80ab5456ed req-6fb594ec-aca4-4bc0-b46f-9b5dd68ec303 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-3b2a694f-907b-46ea-bcc6-8b80ab5456ed req-6fb594ec-aca4-4bc0-b46f-9b5dd68ec303 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:17 user nova-compute[74934]: WARNING nova.compute.manager [req-3b2a694f-907b-46ea-bcc6-8b80ab5456ed req-6fb594ec-aca4-4bc0-b46f-9b5dd68ec303 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state building and task_state spawning.
Nov 19 14:51:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "454533ea-062a-4638-bd8a-72091c6106cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "454533ea-062a-4638-bd8a-72091c6106cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:51:19 user nova-compute[74934]: INFO nova.compute.claims [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Claim successful on node user
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:51:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance spawned successfully.
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-2f9e1c61-b65b-4bc5-a44b-4059d90a24bc req-fceeb3ca-9c4b-4327-8ef5-3fe19d864828 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2f9e1c61-b65b-4bc5-a44b-4059d90a24bc req-fceeb3ca-9c4b-4327-8ef5-3fe19d864828 service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2f9e1c61-b65b-4bc5-a44b-4059d90a24bc req-fceeb3ca-9c4b-4327-8ef5-3fe19d864828 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2f9e1c61-b65b-4bc5-a44b-4059d90a24bc req-fceeb3ca-9c4b-4327-8ef5-3fe19d864828 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-2f9e1c61-b65b-4bc5-a44b-4059d90a24bc req-fceeb3ca-9c4b-4327-8ef5-3fe19d864828 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:19 user nova-compute[74934]: WARNING nova.compute.manager [req-2f9e1c61-b65b-4bc5-a44b-4059d90a24bc req-fceeb3ca-9c4b-4327-8ef5-3fe19d864828 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state building and task_state spawning.
Nov 19 14:51:19 user nova-compute[74934]: INFO nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:51:19 user nova-compute[74934]: INFO nova.compute.manager [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Took 18.47 seconds to build instance.
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ed582b6-a88a-4197-aa8d-95327e665021 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.613s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:51:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.policy [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '563b7f767dd949cf8813529257cd7001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3605109f7c2469095a20fe29e980ac3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:51:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Creating image(s)
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "/opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "/opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "/opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Successfully created port: 47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk 1073741824" returned: 0 in 0.052s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Cannot resize image /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Ensure instance console log exists: /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Successfully updated port: 47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "refresh_cache-454533ea-062a-4638-bd8a-72091c6106cb" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquired lock "refresh_cache-454533ea-062a-4638-bd8a-72091c6106cb" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Received event network-changed-47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Refreshing instance network info cache due to event network-changed-47eb5d38-c2b4-44e3-8088-6ee929a64f91. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] Acquiring lock "refresh_cache-454533ea-062a-4638-bd8a-72091c6106cb" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:51:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Updating instance_info_cache with network_info: [{"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Releasing lock "refresh_cache-454533ea-062a-4638-bd8a-72091c6106cb" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Instance network_info: |[{"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] Acquired lock "refresh_cache-454533ea-062a-4638-bd8a-72091c6106cb" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Refreshing network info cache for port 47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Start _get_guest_xml network_info=[{"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:51:21 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:21 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1865424697',display_name='tempest-VolumesAdminNegativeTest-server-1865424697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1865424697',id=15,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3605109f7c2469095a20fe29e980ac3',ramdisk_id='',reservation_id='r-80nzumid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-539978045',owner_user_name='tempest-VolumesAdminNegativeTest-539978045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:20Z,user_data=None,user_id='563b7f767dd949cf8813529257cd7001',uuid=454533ea-062a-4638-bd8a-72091c6106cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converting VIF {"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'pci_devices' on Instance uuid 454533ea-062a-4638-bd8a-72091c6106cb {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:51:21 user nova-compute[74934]:   <uuid>454533ea-062a-4638-bd8a-72091c6106cb</uuid>
Nov 19 14:51:21 user nova-compute[74934]:   <name>instance-0000000f</name>
Nov 19 14:51:21 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:51:21 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:51:21 user nova-compute[74934]:   <metadata>
Nov 19 14:51:21 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:21 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:51:21 user nova-compute[74934]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1865424697</nova:name>
Nov 19 14:51:21 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:51:21</nova:creationTime>
Nov 19 14:51:21 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:51:21 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:21 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:51:21 user nova-compute[74934]:       <nova:owner>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:user uuid="563b7f767dd949cf8813529257cd7001">tempest-VolumesAdminNegativeTest-539978045-project-member</nova:user>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:project uuid="a3605109f7c2469095a20fe29e980ac3">tempest-VolumesAdminNegativeTest-539978045</nova:project>
Nov 19 14:51:21 user nova-compute[74934]:       </nova:owner>
Nov 19 14:51:21 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:21 user nova-compute[74934]:       <nova:ports>
Nov 19 14:51:21 user nova-compute[74934]:         <nova:port uuid="47eb5d38-c2b4-44e3-8088-6ee929a64f91">
Nov 19 14:51:21 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 19 14:51:21 user nova-compute[74934]:         </nova:port>
Nov 19 14:51:21 user nova-compute[74934]:       </nova:ports>
Nov 19 14:51:21 user nova-compute[74934]:     </nova:instance>
Nov 19 14:51:21 user nova-compute[74934]:   </metadata>
Nov 19 14:51:21 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:51:21 user nova-compute[74934]:     <system>
Nov 19 14:51:21 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:51:21 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:51:21 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:51:21 user nova-compute[74934]:       <entry name="serial">454533ea-062a-4638-bd8a-72091c6106cb</entry>
Nov 19 14:51:21 user nova-compute[74934]:       <entry name="uuid">454533ea-062a-4638-bd8a-72091c6106cb</entry>
Nov 19 14:51:21 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:51:21 user nova-compute[74934]:     </system>
Nov 19 14:51:21 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:21 user nova-compute[74934]:   <os>
Nov 19 14:51:21 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:51:21 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:51:21 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:51:21 user nova-compute[74934]:   </os>
Nov 19 14:51:21 user nova-compute[74934]:   <features>
Nov 19 14:51:21 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:21 user nova-compute[74934]:     <apic/>
Nov 19 14:51:21 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:51:21 user nova-compute[74934]:   </features>
Nov 19 14:51:21 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:51:21 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:51:21 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:51:21 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:51:21 user nova-compute[74934]:   </clock>
Nov 19 14:51:21 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:51:21 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:51:21 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:51:21 user nova-compute[74934]:   </cpu>
Nov 19 14:51:21 user nova-compute[74934]:   <devices>
Nov 19 14:51:21 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:51:21 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:51:21 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk"/>
Nov 19 14:51:21 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:51:21 user nova-compute[74934]:     </disk>
Nov 19 14:51:21 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:51:21 user nova-compute[74934]:       <mac address="fa:16:3e:61:ac:10"/>
Nov 19 14:51:21 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:51:21 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:51:21 user nova-compute[74934]:       <target dev="tap47eb5d38-c2"/>
Nov 19 14:51:21 user nova-compute[74934]:     </interface>
Nov 19 14:51:21 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:51:21 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/console.log" append="off"/>
Nov 19 14:51:21 user nova-compute[74934]:     </serial>
Nov 19 14:51:21 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:51:21 user nova-compute[74934]:     <video>
Nov 19 14:51:21 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:51:21 user nova-compute[74934]:     </video>
Nov 19 14:51:21 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:51:21 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:51:21 user nova-compute[74934]:     </rng>
Nov 19 14:51:21 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:51:21 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:51:21 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:51:21 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:21 user nova-compute[74934]:   </devices>
Nov 19 14:51:21 user nova-compute[74934]: </domain>
Nov 19 14:51:21 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1865424697',display_name='tempest-VolumesAdminNegativeTest-server-1865424697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1865424697',id=15,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3605109f7c2469095a20fe29e980ac3',ramdisk_id='',reservation_id='r-80nzumid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-539978045',owner_user_name='tempest-VolumesAdminNegativeTest-539978045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:20Z,user_data=None,user_id='563b7f767dd949cf8813529257cd7001',uuid=454533ea-062a-4638-bd8a-72091c6106cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converting VIF {"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG os_vif [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d5ce25a-df94-51fc-bb14-6d23c2a0f6fe', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47eb5d38-c2, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47eb5d38-c2, col_values=(('qos', UUID('839c2227-7437-469c-bb64-51c864222505')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47eb5d38-c2, col_values=(('external_ids', {'iface-id': '47eb5d38-c2b4-44e3-8088-6ee929a64f91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ac:10', 'vm-uuid': '454533ea-062a-4638-bd8a-72091c6106cb'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:21 user nova-compute[74934]: INFO os_vif [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2')
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] No VIF found with MAC fa:16:3e:61:ac:10, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Updated VIF entry in instance network info cache for port 47eb5d38-c2b4-44e3-8088-6ee929a64f91. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Updating instance_info_cache with network_info: [{"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ede580dc-efaf-477a-bace-57fdb50746f7 req-b438d5ec-e6b2-45b1-921a-5dced0b6bedb service nova] Releasing lock "refresh_cache-454533ea-062a-4638-bd8a-72091c6106cb" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3f353e4-601f-4741-be8e-0550e39059cc req-c9fc7da3-24f7-4873-bb50-ab8470270de9 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Received event network-vif-plugged-47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3f353e4-601f-4741-be8e-0550e39059cc req-c9fc7da3-24f7-4873-bb50-ab8470270de9 service nova] Acquiring lock "454533ea-062a-4638-bd8a-72091c6106cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3f353e4-601f-4741-be8e-0550e39059cc req-c9fc7da3-24f7-4873-bb50-ab8470270de9 service nova] Lock "454533ea-062a-4638-bd8a-72091c6106cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3f353e4-601f-4741-be8e-0550e39059cc req-c9fc7da3-24f7-4873-bb50-ab8470270de9 service nova] Lock "454533ea-062a-4638-bd8a-72091c6106cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3f353e4-601f-4741-be8e-0550e39059cc req-c9fc7da3-24f7-4873-bb50-ab8470270de9 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] No waiting events found dispatching network-vif-plugged-47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:22 user nova-compute[74934]: WARNING nova.compute.manager [req-c3f353e4-601f-4741-be8e-0550e39059cc req-c9fc7da3-24f7-4873-bb50-ab8470270de9 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Received unexpected event network-vif-plugged-47eb5d38-c2b4-44e3-8088-6ee929a64f91 for instance with vm_state building and task_state spawning.
Nov 19 14:51:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:51:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Instance spawned successfully.
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:24 user nova-compute[74934]: INFO nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-a39839dc-04aa-4299-965d-b78ce2185340 req-2a213f79-20ca-47d7-90a5-ab1d09e70c61 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Received event network-vif-plugged-47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a39839dc-04aa-4299-965d-b78ce2185340 req-2a213f79-20ca-47d7-90a5-ab1d09e70c61 service nova] Acquiring lock "454533ea-062a-4638-bd8a-72091c6106cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a39839dc-04aa-4299-965d-b78ce2185340 req-2a213f79-20ca-47d7-90a5-ab1d09e70c61 service nova] Lock "454533ea-062a-4638-bd8a-72091c6106cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a39839dc-04aa-4299-965d-b78ce2185340 req-2a213f79-20ca-47d7-90a5-ab1d09e70c61 service nova] Lock "454533ea-062a-4638-bd8a-72091c6106cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-a39839dc-04aa-4299-965d-b78ce2185340 req-2a213f79-20ca-47d7-90a5-ab1d09e70c61 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] No waiting events found dispatching network-vif-plugged-47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:24 user nova-compute[74934]: WARNING nova.compute.manager [req-a39839dc-04aa-4299-965d-b78ce2185340 req-2a213f79-20ca-47d7-90a5-ab1d09e70c61 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Received unexpected event network-vif-plugged-47eb5d38-c2b4-44e3-8088-6ee929a64f91 for instance with vm_state building and task_state spawning.
Nov 19 14:51:24 user nova-compute[74934]: INFO nova.compute.manager [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Took 5.69 seconds to build instance.
Nov 19 14:51:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e67610e9-aca9-4bdd-8a36-a6a73d55f1c3 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "454533ea-062a-4638-bd8a-72091c6106cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.788s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:24 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Waiting for libvirt event about the detach of device tapa4c5c9bb-69 with device alias net1 from instance b7614315-a839-4dbf-8137-9b4a096bea5b is timed out.
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface> {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 19 14:51:24 user nova-compute[74934]:   <name>instance-00000008</name>
Nov 19 14:51:24 user nova-compute[74934]:   <uuid>b7614315-a839-4dbf-8137-9b4a096bea5b</uuid>
Nov 19 14:51:24 user nova-compute[74934]:   <metadata>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:24 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:50:28</nova:creationTime>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:51:24 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:24 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:owner>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:51:24 user nova-compute[74934]:   </nova:owner>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:ports>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:51:24 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:24 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:port uuid="a4c5c9bb-69dc-4333-ae96-ae4bfe37f839">
Nov 19 14:51:24 user nova-compute[74934]:       <nova:ip type="fixed" address="10.10.10.203" ipVersion="4"/>
Nov 19 14:51:24 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:24 user nova-compute[74934]:   </nova:ports>
Nov 19 14:51:24 user nova-compute[74934]: </nova:instance>
Nov 19 14:51:24 user nova-compute[74934]:   </metadata>
Nov 19 14:51:24 user nova-compute[74934]:   <memory unit='KiB'>524288</memory>
Nov 19 14:51:24 user nova-compute[74934]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 19 14:51:24 user nova-compute[74934]:   <vcpu placement='static'>1</vcpu>
Nov 19 14:51:24 user nova-compute[74934]:   <resource>
Nov 19 14:51:24 user nova-compute[74934]:     <partition>/machine</partition>
Nov 19 14:51:24 user nova-compute[74934]:   </resource>
Nov 19 14:51:24 user nova-compute[74934]:   <sysinfo type='smbios'>
Nov 19 14:51:24 user nova-compute[74934]:     <system>
Nov 19 14:51:24 user nova-compute[74934]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 19 14:51:24 user nova-compute[74934]:       <entry name='product'>OpenStack Nova</entry>
Nov 19 14:51:24 user nova-compute[74934]:       <entry name='version'>0.0.0</entry>
Nov 19 14:51:24 user nova-compute[74934]:       <entry name='serial'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:24 user nova-compute[74934]:       <entry name='uuid'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:24 user nova-compute[74934]:       <entry name='family'>Virtual Machine</entry>
Nov 19 14:51:24 user nova-compute[74934]:     </system>
Nov 19 14:51:24 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:24 user nova-compute[74934]:   <os>
Nov 19 14:51:24 user nova-compute[74934]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 19 14:51:24 user nova-compute[74934]:     <boot dev='hd'/>
Nov 19 14:51:24 user nova-compute[74934]:     <smbios mode='sysinfo'/>
Nov 19 14:51:24 user nova-compute[74934]:   </os>
Nov 19 14:51:24 user nova-compute[74934]:   <features>
Nov 19 14:51:24 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:24 user nova-compute[74934]:     <apic/>
Nov 19 14:51:24 user nova-compute[74934]:     <vmcoreinfo state='on'/>
Nov 19 14:51:24 user nova-compute[74934]:   </features>
Nov 19 14:51:24 user nova-compute[74934]:   <cpu mode='custom' match='exact' check='full'>
Nov 19 14:51:24 user nova-compute[74934]:     <model fallback='forbid'>Nehalem</model>
Nov 19 14:51:24 user nova-compute[74934]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 19 14:51:24 user nova-compute[74934]:     <feature policy='require' name='vme'/>
Nov 19 14:51:24 user nova-compute[74934]:     <feature policy='require' name='x2apic'/>
Nov 19 14:51:24 user nova-compute[74934]:     <feature policy='require' name='hypervisor'/>
Nov 19 14:51:24 user nova-compute[74934]:   </cpu>
Nov 19 14:51:24 user nova-compute[74934]:   <clock offset='utc'>
Nov 19 14:51:24 user nova-compute[74934]:     <timer name='pit' tickpolicy='delay'/>
Nov 19 14:51:24 user nova-compute[74934]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 19 14:51:24 user nova-compute[74934]:     <timer name='hpet' present='no'/>
Nov 19 14:51:24 user nova-compute[74934]:   </clock>
Nov 19 14:51:24 user nova-compute[74934]:   <on_poweroff>destroy</on_poweroff>
Nov 19 14:51:24 user nova-compute[74934]:   <on_reboot>restart</on_reboot>
Nov 19 14:51:24 user nova-compute[74934]:   <on_crash>destroy</on_crash>
Nov 19 14:51:24 user nova-compute[74934]:   <devices>
Nov 19 14:51:24 user nova-compute[74934]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 19 14:51:24 user nova-compute[74934]:     <disk type='file' device='disk'>
Nov 19 14:51:24 user nova-compute[74934]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 19 14:51:24 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk' index='2'/>
Nov 19 14:51:24 user nova-compute[74934]:       <backingStore type='file' index='3'>
Nov 19 14:51:24 user nova-compute[74934]:         <format type='raw'/>
Nov 19 14:51:24 user nova-compute[74934]:         <source file='/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df'/>
Nov 19 14:51:24 user nova-compute[74934]:         <backingStore/>
Nov 19 14:51:24 user nova-compute[74934]:       </backingStore>
Nov 19 14:51:24 user nova-compute[74934]:       <target dev='vda' bus='virtio'/>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='virtio-disk0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </disk>
Nov 19 14:51:24 user nova-compute[74934]:     <disk type='file' device='cdrom'>
Nov 19 14:51:24 user nova-compute[74934]:       <driver name='qemu' type='raw' cache='none'/>
Nov 19 14:51:24 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config' index='1'/>
Nov 19 14:51:24 user nova-compute[74934]:       <backingStore/>
Nov 19 14:51:24 user nova-compute[74934]:       <target dev='hda' bus='ide'/>
Nov 19 14:51:24 user nova-compute[74934]:       <readonly/>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='ide0-0-0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </disk>
Nov 19 14:51:24 user nova-compute[74934]:     <controller type='usb' index='0' model='none'>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='usb'/>
Nov 19 14:51:24 user nova-compute[74934]:     </controller>
Nov 19 14:51:24 user nova-compute[74934]:     <controller type='pci' index='0' model='pci-root'>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='pci.0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </controller>
Nov 19 14:51:24 user nova-compute[74934]:     <controller type='ide' index='0'>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='ide'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 19 14:51:24 user nova-compute[74934]:     </controller>
Nov 19 14:51:24 user nova-compute[74934]:     <interface type='ethernet'>
Nov 19 14:51:24 user nova-compute[74934]:       <mac address='fa:16:3e:7d:a1:30'/>
Nov 19 14:51:24 user nova-compute[74934]:       <target dev='tap99f638f7-1e'/>
Nov 19 14:51:24 user nova-compute[74934]:       <model type='virtio'/>
Nov 19 14:51:24 user nova-compute[74934]:       <mtu size='1442'/>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='net0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </interface>
Nov 19 14:51:24 user nova-compute[74934]:     <serial type='pty'>
Nov 19 14:51:24 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:24 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:24 user nova-compute[74934]:       <target type='isa-serial' port='0'>
Nov 19 14:51:24 user nova-compute[74934]:         <model name='isa-serial'/>
Nov 19 14:51:24 user nova-compute[74934]:       </target>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </serial>
Nov 19 14:51:24 user nova-compute[74934]:     <console type='pty' tty='/dev/pts/7'>
Nov 19 14:51:24 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:24 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:24 user nova-compute[74934]:       <target type='serial' port='0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </console>
Nov 19 14:51:24 user nova-compute[74934]:     <input type='mouse' bus='ps2'>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='input0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </input>
Nov 19 14:51:24 user nova-compute[74934]:     <input type='keyboard' bus='ps2'>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='input1'/>
Nov 19 14:51:24 user nova-compute[74934]:     </input>
Nov 19 14:51:24 user nova-compute[74934]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 19 14:51:24 user nova-compute[74934]:       <listen type='address' address='0.0.0.0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </graphics>
Nov 19 14:51:24 user nova-compute[74934]:     <audio id='1' type='none'/>
Nov 19 14:51:24 user nova-compute[74934]:     <video>
Nov 19 14:51:24 user nova-compute[74934]:       <model type='virtio' heads='1' primary='yes'/>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='video0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </video>
Nov 19 14:51:24 user nova-compute[74934]:     <memballoon model='virtio'>
Nov 19 14:51:24 user nova-compute[74934]:       <stats period='10'/>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='balloon0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:24 user nova-compute[74934]:     <rng model='virtio'>
Nov 19 14:51:24 user nova-compute[74934]:       <backend model='random'>/dev/urandom</backend>
Nov 19 14:51:24 user nova-compute[74934]:       <alias name='rng0'/>
Nov 19 14:51:24 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 19 14:51:24 user nova-compute[74934]:     </rng>
Nov 19 14:51:24 user nova-compute[74934]:   </devices>
Nov 19 14:51:24 user nova-compute[74934]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 19 14:51:24 user nova-compute[74934]:     <label>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</label>
Nov 19 14:51:24 user nova-compute[74934]:     <imagelabel>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</imagelabel>
Nov 19 14:51:24 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:24 user nova-compute[74934]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 19 14:51:24 user nova-compute[74934]:     <label>+64055:+108</label>
Nov 19 14:51:24 user nova-compute[74934]:     <imagelabel>+64055:+108</imagelabel>
Nov 19 14:51:24 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:24 user nova-compute[74934]: </domain>
Nov 19 14:51:24 user nova-compute[74934]:  {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 19 14:51:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully detached device tapa4c5c9bb-69 from instance b7614315-a839-4dbf-8137-9b4a096bea5b from the live domain config.
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG os_vif [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4c5c9bb-69, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d731f57-d83f-46ef-bf3a-a6c944ae33e3) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:24 user nova-compute[74934]: INFO os_vif [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69')
Nov 19 14:51:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:24 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:51:24</nova:creationTime>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:51:24 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:24 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:owner>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:51:24 user nova-compute[74934]:   </nova:owner>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:24 user nova-compute[74934]:   <nova:ports>
Nov 19 14:51:24 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:51:24 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:24 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:24 user nova-compute[74934]:   </nova:ports>
Nov 19 14:51:24 user nova-compute[74934]: </nova:instance>
Nov 19 14:51:24 user nova-compute[74934]:  {{(pid=74934) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-deleted-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:25 user nova-compute[74934]: INFO nova.compute.manager [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Neutron deleted interface a4c5c9bb-69dc-4333-ae96-ae4bfe37f839; detaching it from the instance and deleting it from the info cache
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.objects.instance [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Lazy-loading 'system_metadata' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquired lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.objects.instance [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Lazy-loading 'flavor' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.objects.base [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Object Instance<b7614315-a839-4dbf-8137-9b4a096bea5b> lazy-loaded attributes: system_metadata,flavor {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.os_vif_util [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Converting VIF {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.os_vif_util [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface> {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 19 14:51:25 user nova-compute[74934]:   <name>instance-00000008</name>
Nov 19 14:51:25 user nova-compute[74934]:   <uuid>b7614315-a839-4dbf-8137-9b4a096bea5b</uuid>
Nov 19 14:51:25 user nova-compute[74934]:   <metadata>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:25 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:51:24</nova:creationTime>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:51:25 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:owner>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:owner>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:ports>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:51:25 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:25 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:ports>
Nov 19 14:51:25 user nova-compute[74934]: </nova:instance>
Nov 19 14:51:25 user nova-compute[74934]:   </metadata>
Nov 19 14:51:25 user nova-compute[74934]:   <memory unit='KiB'>524288</memory>
Nov 19 14:51:25 user nova-compute[74934]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 19 14:51:25 user nova-compute[74934]:   <vcpu placement='static'>1</vcpu>
Nov 19 14:51:25 user nova-compute[74934]:   <resource>
Nov 19 14:51:25 user nova-compute[74934]:     <partition>/machine</partition>
Nov 19 14:51:25 user nova-compute[74934]:   </resource>
Nov 19 14:51:25 user nova-compute[74934]:   <sysinfo type='smbios'>
Nov 19 14:51:25 user nova-compute[74934]:     <system>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='product'>OpenStack Nova</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='version'>0.0.0</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='serial'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='uuid'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='family'>Virtual Machine</entry>
Nov 19 14:51:25 user nova-compute[74934]:     </system>
Nov 19 14:51:25 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:25 user nova-compute[74934]:   <os>
Nov 19 14:51:25 user nova-compute[74934]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 19 14:51:25 user nova-compute[74934]:     <boot dev='hd'/>
Nov 19 14:51:25 user nova-compute[74934]:     <smbios mode='sysinfo'/>
Nov 19 14:51:25 user nova-compute[74934]:   </os>
Nov 19 14:51:25 user nova-compute[74934]:   <features>
Nov 19 14:51:25 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:25 user nova-compute[74934]:     <apic/>
Nov 19 14:51:25 user nova-compute[74934]:     <vmcoreinfo state='on'/>
Nov 19 14:51:25 user nova-compute[74934]:   </features>
Nov 19 14:51:25 user nova-compute[74934]:   <cpu mode='custom' match='exact' check='full'>
Nov 19 14:51:25 user nova-compute[74934]:     <model fallback='forbid'>Nehalem</model>
Nov 19 14:51:25 user nova-compute[74934]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 19 14:51:25 user nova-compute[74934]:     <feature policy='require' name='vme'/>
Nov 19 14:51:25 user nova-compute[74934]:     <feature policy='require' name='x2apic'/>
Nov 19 14:51:25 user nova-compute[74934]:     <feature policy='require' name='hypervisor'/>
Nov 19 14:51:25 user nova-compute[74934]:   </cpu>
Nov 19 14:51:25 user nova-compute[74934]:   <clock offset='utc'>
Nov 19 14:51:25 user nova-compute[74934]:     <timer name='pit' tickpolicy='delay'/>
Nov 19 14:51:25 user nova-compute[74934]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 19 14:51:25 user nova-compute[74934]:     <timer name='hpet' present='no'/>
Nov 19 14:51:25 user nova-compute[74934]:   </clock>
Nov 19 14:51:25 user nova-compute[74934]:   <on_poweroff>destroy</on_poweroff>
Nov 19 14:51:25 user nova-compute[74934]:   <on_reboot>restart</on_reboot>
Nov 19 14:51:25 user nova-compute[74934]:   <on_crash>destroy</on_crash>
Nov 19 14:51:25 user nova-compute[74934]:   <devices>
Nov 19 14:51:25 user nova-compute[74934]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 19 14:51:25 user nova-compute[74934]:     <disk type='file' device='disk'>
Nov 19 14:51:25 user nova-compute[74934]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 19 14:51:25 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk' index='2'/>
Nov 19 14:51:25 user nova-compute[74934]:       <backingStore type='file' index='3'>
Nov 19 14:51:25 user nova-compute[74934]:         <format type='raw'/>
Nov 19 14:51:25 user nova-compute[74934]:         <source file='/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df'/>
Nov 19 14:51:25 user nova-compute[74934]:         <backingStore/>
Nov 19 14:51:25 user nova-compute[74934]:       </backingStore>
Nov 19 14:51:25 user nova-compute[74934]:       <target dev='vda' bus='virtio'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='virtio-disk0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </disk>
Nov 19 14:51:25 user nova-compute[74934]:     <disk type='file' device='cdrom'>
Nov 19 14:51:25 user nova-compute[74934]:       <driver name='qemu' type='raw' cache='none'/>
Nov 19 14:51:25 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config' index='1'/>
Nov 19 14:51:25 user nova-compute[74934]:       <backingStore/>
Nov 19 14:51:25 user nova-compute[74934]:       <target dev='hda' bus='ide'/>
Nov 19 14:51:25 user nova-compute[74934]:       <readonly/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='ide0-0-0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </disk>
Nov 19 14:51:25 user nova-compute[74934]:     <controller type='usb' index='0' model='none'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='usb'/>
Nov 19 14:51:25 user nova-compute[74934]:     </controller>
Nov 19 14:51:25 user nova-compute[74934]:     <controller type='pci' index='0' model='pci-root'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='pci.0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </controller>
Nov 19 14:51:25 user nova-compute[74934]:     <controller type='ide' index='0'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='ide'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 19 14:51:25 user nova-compute[74934]:     </controller>
Nov 19 14:51:25 user nova-compute[74934]:     <interface type='ethernet'>
Nov 19 14:51:25 user nova-compute[74934]:       <mac address='fa:16:3e:7d:a1:30'/>
Nov 19 14:51:25 user nova-compute[74934]:       <target dev='tap99f638f7-1e'/>
Nov 19 14:51:25 user nova-compute[74934]:       <model type='virtio'/>
Nov 19 14:51:25 user nova-compute[74934]:       <mtu size='1442'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='net0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </interface>
Nov 19 14:51:25 user nova-compute[74934]:     <serial type='pty'>
Nov 19 14:51:25 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:25 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:25 user nova-compute[74934]:       <target type='isa-serial' port='0'>
Nov 19 14:51:25 user nova-compute[74934]:         <model name='isa-serial'/>
Nov 19 14:51:25 user nova-compute[74934]:       </target>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </serial>
Nov 19 14:51:25 user nova-compute[74934]:     <console type='pty' tty='/dev/pts/7'>
Nov 19 14:51:25 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:25 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:25 user nova-compute[74934]:       <target type='serial' port='0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </console>
Nov 19 14:51:25 user nova-compute[74934]:     <input type='mouse' bus='ps2'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='input0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </input>
Nov 19 14:51:25 user nova-compute[74934]:     <input type='keyboard' bus='ps2'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='input1'/>
Nov 19 14:51:25 user nova-compute[74934]:     </input>
Nov 19 14:51:25 user nova-compute[74934]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 19 14:51:25 user nova-compute[74934]:       <listen type='address' address='0.0.0.0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </graphics>
Nov 19 14:51:25 user nova-compute[74934]:     <audio id='1' type='none'/>
Nov 19 14:51:25 user nova-compute[74934]:     <video>
Nov 19 14:51:25 user nova-compute[74934]:       <model type='virtio' heads='1' primary='yes'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='video0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </video>
Nov 19 14:51:25 user nova-compute[74934]:     <memballoon model='virtio'>
Nov 19 14:51:25 user nova-compute[74934]:       <stats period='10'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='balloon0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:25 user nova-compute[74934]:     <rng model='virtio'>
Nov 19 14:51:25 user nova-compute[74934]:       <backend model='random'>/dev/urandom</backend>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='rng0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </rng>
Nov 19 14:51:25 user nova-compute[74934]:   </devices>
Nov 19 14:51:25 user nova-compute[74934]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 19 14:51:25 user nova-compute[74934]:     <label>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</label>
Nov 19 14:51:25 user nova-compute[74934]:     <imagelabel>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</imagelabel>
Nov 19 14:51:25 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:25 user nova-compute[74934]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 19 14:51:25 user nova-compute[74934]:     <label>+64055:+108</label>
Nov 19 14:51:25 user nova-compute[74934]:     <imagelabel>+64055:+108</imagelabel>
Nov 19 14:51:25 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:25 user nova-compute[74934]: </domain>
Nov 19 14:51:25 user nova-compute[74934]:  {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface> {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:5e:05:4d"/><model type="virtio"/><mtu size="1442"/><target dev="tapa4c5c9bb-69"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 19 14:51:25 user nova-compute[74934]:   <name>instance-00000008</name>
Nov 19 14:51:25 user nova-compute[74934]:   <uuid>b7614315-a839-4dbf-8137-9b4a096bea5b</uuid>
Nov 19 14:51:25 user nova-compute[74934]:   <metadata>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:25 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:51:24</nova:creationTime>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:51:25 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:owner>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:owner>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:ports>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:51:25 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:25 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:ports>
Nov 19 14:51:25 user nova-compute[74934]: </nova:instance>
Nov 19 14:51:25 user nova-compute[74934]:   </metadata>
Nov 19 14:51:25 user nova-compute[74934]:   <memory unit='KiB'>524288</memory>
Nov 19 14:51:25 user nova-compute[74934]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 19 14:51:25 user nova-compute[74934]:   <vcpu placement='static'>1</vcpu>
Nov 19 14:51:25 user nova-compute[74934]:   <resource>
Nov 19 14:51:25 user nova-compute[74934]:     <partition>/machine</partition>
Nov 19 14:51:25 user nova-compute[74934]:   </resource>
Nov 19 14:51:25 user nova-compute[74934]:   <sysinfo type='smbios'>
Nov 19 14:51:25 user nova-compute[74934]:     <system>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='product'>OpenStack Nova</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='version'>0.0.0</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='serial'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='uuid'>b7614315-a839-4dbf-8137-9b4a096bea5b</entry>
Nov 19 14:51:25 user nova-compute[74934]:       <entry name='family'>Virtual Machine</entry>
Nov 19 14:51:25 user nova-compute[74934]:     </system>
Nov 19 14:51:25 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:25 user nova-compute[74934]:   <os>
Nov 19 14:51:25 user nova-compute[74934]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 19 14:51:25 user nova-compute[74934]:     <boot dev='hd'/>
Nov 19 14:51:25 user nova-compute[74934]:     <smbios mode='sysinfo'/>
Nov 19 14:51:25 user nova-compute[74934]:   </os>
Nov 19 14:51:25 user nova-compute[74934]:   <features>
Nov 19 14:51:25 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:25 user nova-compute[74934]:     <apic/>
Nov 19 14:51:25 user nova-compute[74934]:     <vmcoreinfo state='on'/>
Nov 19 14:51:25 user nova-compute[74934]:   </features>
Nov 19 14:51:25 user nova-compute[74934]:   <cpu mode='custom' match='exact' check='full'>
Nov 19 14:51:25 user nova-compute[74934]:     <model fallback='forbid'>Nehalem</model>
Nov 19 14:51:25 user nova-compute[74934]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 19 14:51:25 user nova-compute[74934]:     <feature policy='require' name='vme'/>
Nov 19 14:51:25 user nova-compute[74934]:     <feature policy='require' name='x2apic'/>
Nov 19 14:51:25 user nova-compute[74934]:     <feature policy='require' name='hypervisor'/>
Nov 19 14:51:25 user nova-compute[74934]:   </cpu>
Nov 19 14:51:25 user nova-compute[74934]:   <clock offset='utc'>
Nov 19 14:51:25 user nova-compute[74934]:     <timer name='pit' tickpolicy='delay'/>
Nov 19 14:51:25 user nova-compute[74934]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 19 14:51:25 user nova-compute[74934]:     <timer name='hpet' present='no'/>
Nov 19 14:51:25 user nova-compute[74934]:   </clock>
Nov 19 14:51:25 user nova-compute[74934]:   <on_poweroff>destroy</on_poweroff>
Nov 19 14:51:25 user nova-compute[74934]:   <on_reboot>restart</on_reboot>
Nov 19 14:51:25 user nova-compute[74934]:   <on_crash>destroy</on_crash>
Nov 19 14:51:25 user nova-compute[74934]:   <devices>
Nov 19 14:51:25 user nova-compute[74934]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 19 14:51:25 user nova-compute[74934]:     <disk type='file' device='disk'>
Nov 19 14:51:25 user nova-compute[74934]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 19 14:51:25 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk' index='2'/>
Nov 19 14:51:25 user nova-compute[74934]:       <backingStore type='file' index='3'>
Nov 19 14:51:25 user nova-compute[74934]:         <format type='raw'/>
Nov 19 14:51:25 user nova-compute[74934]:         <source file='/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df'/>
Nov 19 14:51:25 user nova-compute[74934]:         <backingStore/>
Nov 19 14:51:25 user nova-compute[74934]:       </backingStore>
Nov 19 14:51:25 user nova-compute[74934]:       <target dev='vda' bus='virtio'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='virtio-disk0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </disk>
Nov 19 14:51:25 user nova-compute[74934]:     <disk type='file' device='cdrom'>
Nov 19 14:51:25 user nova-compute[74934]:       <driver name='qemu' type='raw' cache='none'/>
Nov 19 14:51:25 user nova-compute[74934]:       <source file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk.config' index='1'/>
Nov 19 14:51:25 user nova-compute[74934]:       <backingStore/>
Nov 19 14:51:25 user nova-compute[74934]:       <target dev='hda' bus='ide'/>
Nov 19 14:51:25 user nova-compute[74934]:       <readonly/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='ide0-0-0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </disk>
Nov 19 14:51:25 user nova-compute[74934]:     <controller type='usb' index='0' model='none'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='usb'/>
Nov 19 14:51:25 user nova-compute[74934]:     </controller>
Nov 19 14:51:25 user nova-compute[74934]:     <controller type='pci' index='0' model='pci-root'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='pci.0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </controller>
Nov 19 14:51:25 user nova-compute[74934]:     <controller type='ide' index='0'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='ide'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 19 14:51:25 user nova-compute[74934]:     </controller>
Nov 19 14:51:25 user nova-compute[74934]:     <interface type='ethernet'>
Nov 19 14:51:25 user nova-compute[74934]:       <mac address='fa:16:3e:7d:a1:30'/>
Nov 19 14:51:25 user nova-compute[74934]:       <target dev='tap99f638f7-1e'/>
Nov 19 14:51:25 user nova-compute[74934]:       <model type='virtio'/>
Nov 19 14:51:25 user nova-compute[74934]:       <mtu size='1442'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='net0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </interface>
Nov 19 14:51:25 user nova-compute[74934]:     <serial type='pty'>
Nov 19 14:51:25 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:25 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:25 user nova-compute[74934]:       <target type='isa-serial' port='0'>
Nov 19 14:51:25 user nova-compute[74934]:         <model name='isa-serial'/>
Nov 19 14:51:25 user nova-compute[74934]:       </target>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </serial>
Nov 19 14:51:25 user nova-compute[74934]:     <console type='pty' tty='/dev/pts/7'>
Nov 19 14:51:25 user nova-compute[74934]:       <source path='/dev/pts/7'/>
Nov 19 14:51:25 user nova-compute[74934]:       <log file='/opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/console.log' append='off'/>
Nov 19 14:51:25 user nova-compute[74934]:       <target type='serial' port='0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='serial0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </console>
Nov 19 14:51:25 user nova-compute[74934]:     <input type='mouse' bus='ps2'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='input0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </input>
Nov 19 14:51:25 user nova-compute[74934]:     <input type='keyboard' bus='ps2'>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='input1'/>
Nov 19 14:51:25 user nova-compute[74934]:     </input>
Nov 19 14:51:25 user nova-compute[74934]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 19 14:51:25 user nova-compute[74934]:       <listen type='address' address='0.0.0.0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </graphics>
Nov 19 14:51:25 user nova-compute[74934]:     <audio id='1' type='none'/>
Nov 19 14:51:25 user nova-compute[74934]:     <video>
Nov 19 14:51:25 user nova-compute[74934]:       <model type='virtio' heads='1' primary='yes'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='video0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </video>
Nov 19 14:51:25 user nova-compute[74934]:     <memballoon model='virtio'>
Nov 19 14:51:25 user nova-compute[74934]:       <stats period='10'/>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='balloon0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:25 user nova-compute[74934]:     <rng model='virtio'>
Nov 19 14:51:25 user nova-compute[74934]:       <backend model='random'>/dev/urandom</backend>
Nov 19 14:51:25 user nova-compute[74934]:       <alias name='rng0'/>
Nov 19 14:51:25 user nova-compute[74934]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 19 14:51:25 user nova-compute[74934]:     </rng>
Nov 19 14:51:25 user nova-compute[74934]:   </devices>
Nov 19 14:51:25 user nova-compute[74934]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 19 14:51:25 user nova-compute[74934]:     <label>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</label>
Nov 19 14:51:25 user nova-compute[74934]:     <imagelabel>libvirt-b7614315-a839-4dbf-8137-9b4a096bea5b</imagelabel>
Nov 19 14:51:25 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:25 user nova-compute[74934]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 19 14:51:25 user nova-compute[74934]:     <label>+64055:+108</label>
Nov 19 14:51:25 user nova-compute[74934]:     <imagelabel>+64055:+108</imagelabel>
Nov 19 14:51:25 user nova-compute[74934]:   </seclabel>
Nov 19 14:51:25 user nova-compute[74934]: </domain>
Nov 19 14:51:25 user nova-compute[74934]:  {{(pid=74934) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 19 14:51:25 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Detaching interface fa:16:3e:5e:05:4d failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa4c5c9bb-69' not found.
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.os_vif_util [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Converting VIF {"id": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "address": "fa:16:3e:5e:05:4d", "network": {"id": "d3ce15ee-6d70-4c27-bad9-18832b4e8942", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1604902171", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c5c9bb-69", "ovs_interfaceid": "a4c5c9bb-69dc-4333-ae96-ae4bfe37f839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.os_vif_util [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG os_vif [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4c5c9bb-69, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:51:25 user nova-compute[74934]: INFO os_vif [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:05:4d,bridge_name='br-int',has_traffic_filtering=True,id=a4c5c9bb-69dc-4333-ae96-ae4bfe37f839,network=Network(d3ce15ee-6d70-4c27-bad9-18832b4e8942),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4c5c9bb-69')
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [req-6b866906-2a4b-4871-afb8-f582c0404618 req-5c8c1c82-bd63-4d7e-bccc-9c8e1455892c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:25 user nova-compute[74934]:   <nova:package version="0.0.0"/>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:name>tempest-device-tagging-server-2021700031</nova:name>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:creationTime>2023-11-19 14:51:25</nova:creationTime>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:flavor name="m1.tiny">
Nov 19 14:51:25 user nova-compute[74934]:     <nova:memory>512</nova:memory>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:disk>1</nova:disk>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:swap>0</nova:swap>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:flavor>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:owner>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:user uuid="5575961a25d9487ab557835abe15c460">tempest-TaggedAttachmentsTest-246323927-project-member</nova:user>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:project uuid="5463253de6814508960ba3cd7514bb77">tempest-TaggedAttachmentsTest-246323927</nova:project>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:owner>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:25 user nova-compute[74934]:   <nova:ports>
Nov 19 14:51:25 user nova-compute[74934]:     <nova:port uuid="99f638f7-1e8c-4ae1-b4ed-c6a438e703f4">
Nov 19 14:51:25 user nova-compute[74934]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:25 user nova-compute[74934]:     </nova:port>
Nov 19 14:51:25 user nova-compute[74934]:   </nova:ports>
Nov 19 14:51:25 user nova-compute[74934]: </nova:instance>
Nov 19 14:51:25 user nova-compute[74934]:  {{(pid=74934) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [{"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Releasing lock "refresh_cache-b7614315-a839-4dbf-8137-9b4a096bea5b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e4ac16e-4d43-4d4b-9797-ad3a947a16e3 tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "interface-b7614315-a839-4dbf-8137-9b4a096bea5b-a4c5c9bb-69dc-4333-ae96-ae4bfe37f839" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.403s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:30 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60dddb96-ee81-4cc8-8960-7e0189d4543b is timed out.
Nov 19 14:51:30 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Successfully detached device vdb from instance 60dddb96-ee81-4cc8-8960-7e0189d4543b from the live domain config.
Nov 19 14:51:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfaGpDlL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'd40ecd8e-7930-420d-aab7-a745c6222a9b'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:30 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee81f13-24f0-4204-ae86-29b31369f0d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:51:30 user nova-compute[74934]: No targets found.
Nov 19 14:51:30 user nova-compute[74934]: iSNS:
Nov 19 14:51:30 user nova-compute[74934]: No targets found.
Nov 19 14:51:30 user nova-compute[74934]: STATIC:
Nov 19 14:51:30 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b
Nov 19 14:51:30 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:30 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:30 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:51:30 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:51:30 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:51:30 user nova-compute[74934]: FIRMWARE:
Nov 19 14:51:30 user nova-compute[74934]: No targets found.
Nov 19 14:51:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:51:30 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:51:30 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dcb33f-dbf3-4b1f-a9b1-29961b9f6f8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[632fb183-0926-4533-98c2-b6ff8da749f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:30 user nova-compute[74934]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:51:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b (non-flash)
Nov 19 14:51:30 user nova-compute[74934]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:51:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4446cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b'): ({'sdh'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Removing single pathed devices sdh {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[038509e6-1eff-4271-981f-eb04a9947b0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db5771-1417-4a6f-b0c0-95572d2fe95c]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Flushing IO for device /dev/sdh {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e2ff2-2834-4687-acd6-fd3b023b37e1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d830b83b-78df-4456-84ea-6b51f23d9bf5]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] SCSI volumes sdh have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1683b2-b2d8-485b-a52c-15338bfdb8e1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[016617a9-c836-4461-ad58-7b553f998bbc]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260]
Nov 19 14:51:30 user nova-compute[74934]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b, portal: 172.16.0.220,3260] successful.
Nov 19 14:51:30 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ecd8e-7930-420d-aab7-a745c6222a9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17f6b1e-9b97-4aab-b408-7ce924604c83]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] <== disconnect_volume: return (278ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:51:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:51:31 user nova-compute[74934]: DEBUG nova.objects.instance [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lazy-loading 'flavor' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cacf47b5-3849-455b-ae48-8e1872651a99 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.568s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 14:51:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:51:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:51:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:38 user nova-compute[74934]: INFO nova.compute.manager [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Terminating instance
Nov 19 14:51:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-f0ee7fe9-2718-415b-b4aa-b910a0814922 req-a42519b4-3848-44bf-ab1a-5cac9ca32758 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-vif-unplugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f0ee7fe9-2718-415b-b4aa-b910a0814922 req-a42519b4-3848-44bf-ab1a-5cac9ca32758 service nova] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f0ee7fe9-2718-415b-b4aa-b910a0814922 req-a42519b4-3848-44bf-ab1a-5cac9ca32758 service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f0ee7fe9-2718-415b-b4aa-b910a0814922 req-a42519b4-3848-44bf-ab1a-5cac9ca32758 service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-f0ee7fe9-2718-415b-b4aa-b910a0814922 req-a42519b4-3848-44bf-ab1a-5cac9ca32758 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] No waiting events found dispatching network-vif-unplugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-f0ee7fe9-2718-415b-b4aa-b910a0814922 req-a42519b4-3848-44bf-ab1a-5cac9ca32758 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-vif-unplugged-b687d602-81e2-4dab-bca7-db920bdf634b for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Instance destroyed successfully.
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lazy-loading 'resources' on Instance uuid bc1c6696-09e5-487d-a9bf-0530f2fc5295 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1853069119',display_name='tempest-VolumesAssistedSnapshotsTest-server-1853069119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1853069119',id=10,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHOteLrU6m3vEkQFbtYyEmAj9Aj7z+pBxDLtWPSyWPqk4BqjMfZRafoxO4EseJdBd2AElHaQJdhIg+kwyK11Qijftwy/OBj7LLuUu2FL+5n1niRfY6PRn5ZMJL98We5XQ==',key_name='tempest-keypair-1286933828',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13dddf2b6ce6430588213024af4d9096',ramdisk_id='',reservation_id='r-sl3k5bla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-212568249',owner_user_name='tempest-VolumesAssistedSnapshotsTest-212568249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad30f14adf55433aa9164681e70e846a',uuid=bc1c6696-09e5-487d-a9bf-0530f2fc5295,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Converting VIF {"id": "b687d602-81e2-4dab-bca7-db920bdf634b", "address": "fa:16:3e:36:f6:86", "network": {"id": "51c25421-cf46-410f-ac0a-37437a1a4ae1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-146566320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13dddf2b6ce6430588213024af4d9096", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb687d602-81", "ovs_interfaceid": "b687d602-81e2-4dab-bca7-db920bdf634b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG os_vif [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb687d602-81, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68c88b6b-8ff7-48bd-a073-2bb37e40d09e) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:39 user nova-compute[74934]: INFO os_vif [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=b687d602-81e2-4dab-bca7-db920bdf634b,network=Network(51c25421-cf46-410f-ac0a-37437a1a4ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb687d602-81')
Nov 19 14:51:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Deleting instance files /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295_del
Nov 19 14:51:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Deletion of /opt/stack/data/nova/instances/bc1c6696-09e5-487d-a9bf-0530f2fc5295_del complete
Nov 19 14:51:39 user nova-compute[74934]: INFO nova.compute.manager [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 19 14:51:39 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:51:39 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-beca9a18-018d-4f10-b082-5938763b0058 req-e366837a-6a44-4f6e-9148-f96d1ce96083 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-vif-deleted-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:40 user nova-compute[74934]: INFO nova.compute.manager [req-beca9a18-018d-4f10-b082-5938763b0058 req-e366837a-6a44-4f6e-9148-f96d1ce96083 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Neutron deleted interface b687d602-81e2-4dab-bca7-db920bdf634b; detaching it from the instance and deleting it from the info cache
Nov 19 14:51:40 user nova-compute[74934]: DEBUG nova.network.neutron [req-beca9a18-018d-4f10-b082-5938763b0058 req-e366837a-6a44-4f6e-9148-f96d1ce96083 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:40 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Took 0.82 seconds to deallocate network for instance.
Nov 19 14:51:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-beca9a18-018d-4f10-b082-5938763b0058 req-e366837a-6a44-4f6e-9148-f96d1ce96083 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Detach interface failed, port_id=b687d602-81e2-4dab-bca7-db920bdf634b, reason: Instance bc1c6696-09e5-487d-a9bf-0530f2fc5295 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:40 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Deleted allocations for instance bc1c6696-09e5-487d-a9bf-0530f2fc5295
Nov 19 14:51:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f38a30cf-04b9-4b27-920b-c5451873da01 tempest-VolumesAssistedSnapshotsTest-212568249 tempest-VolumesAssistedSnapshotsTest-212568249-project-member] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-d1b7b593-079d-469b-a6e9-fc00d4a27852 req-edecb21f-abca-420d-9e94-e894ea409aa3 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received event network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d1b7b593-079d-469b-a6e9-fc00d4a27852 req-edecb21f-abca-420d-9e94-e894ea409aa3 service nova] Acquiring lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d1b7b593-079d-469b-a6e9-fc00d4a27852 req-edecb21f-abca-420d-9e94-e894ea409aa3 service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d1b7b593-079d-469b-a6e9-fc00d4a27852 req-edecb21f-abca-420d-9e94-e894ea409aa3 service nova] Lock "bc1c6696-09e5-487d-a9bf-0530f2fc5295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-d1b7b593-079d-469b-a6e9-fc00d4a27852 req-edecb21f-abca-420d-9e94-e894ea409aa3 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] No waiting events found dispatching network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:41 user nova-compute[74934]: WARNING nova.compute.manager [req-d1b7b593-079d-469b-a6e9-fc00d4a27852 req-edecb21f-abca-420d-9e94-e894ea409aa3 service nova] [instance: bc1c6696-09e5-487d-a9bf-0530f2fc5295] Received unexpected event network-vif-plugged-b687d602-81e2-4dab-bca7-db920bdf634b for instance with vm_state deleted and task_state None.
Nov 19 14:51:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:51:46 user nova-compute[74934]: INFO nova.compute.claims [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Claim successful on node user
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.network.neutron [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:51:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:51:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:51:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Creating image(s)
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG nova.policy [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77319d6b70b24f22b39342f6955a8fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2d42525428465c90522337ec5a4b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.280s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk 1073741824" returned: 0 in 0.080s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.229s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:51:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Cannot resize image /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Ensure instance console log exists: /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Successfully created port: d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Successfully updated port: d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquired lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-changed-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Refreshing instance network info cache due to event network-changed-d827e47e-9033-4f04-9987-837c6460c55a. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:51:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] Acquiring lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating instance_info_cache with network_info: [{"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Releasing lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance network_info: |[{"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] Acquired lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Refreshing network info cache for port d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Start _get_guest_xml network_info=[{"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:51:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964213297',display_name='tempest-tempest.common.compute-instance-1964213297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964213297',id=16,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BUBDk+mwq/G25w9oNvmbP7s6FB+a/JpUr7aZTk9Pqcry6VoWsygtGANdxOPdDD1+3EVI+ZkoTIkvxM7DRi4n6FFHnmiarrXth1XJhv1EKmLWhiVBJixe4uk06xQaXxQ==',key_name='tempest-keypair-688273119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-d3000n5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=4e1f21d2-f784-49d3-b2f4-52f0226c048b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:51:49 user nova-compute[74934]:   <uuid>4e1f21d2-f784-49d3-b2f4-52f0226c048b</uuid>
Nov 19 14:51:49 user nova-compute[74934]:   <name>instance-00000010</name>
Nov 19 14:51:49 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:51:49 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:51:49 user nova-compute[74934]:   <metadata>
Nov 19 14:51:49 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:51:49 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:51:49 user nova-compute[74934]:       <nova:name>tempest-tempest.common.compute-instance-1964213297</nova:name>
Nov 19 14:51:49 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:51:49</nova:creationTime>
Nov 19 14:51:49 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:51:49 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:51:49 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:51:49 user nova-compute[74934]:       <nova:owner>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:user uuid="77319d6b70b24f22b39342f6955a8fef">tempest-ServerActionsTestOtherA-463456576-project-member</nova:user>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:project uuid="bd2d42525428465c90522337ec5a4b82">tempest-ServerActionsTestOtherA-463456576</nova:project>
Nov 19 14:51:49 user nova-compute[74934]:       </nova:owner>
Nov 19 14:51:49 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:51:49 user nova-compute[74934]:       <nova:ports>
Nov 19 14:51:49 user nova-compute[74934]:         <nova:port uuid="d827e47e-9033-4f04-9987-837c6460c55a">
Nov 19 14:51:49 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:51:49 user nova-compute[74934]:         </nova:port>
Nov 19 14:51:49 user nova-compute[74934]:       </nova:ports>
Nov 19 14:51:49 user nova-compute[74934]:     </nova:instance>
Nov 19 14:51:49 user nova-compute[74934]:   </metadata>
Nov 19 14:51:49 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:51:49 user nova-compute[74934]:     <system>
Nov 19 14:51:49 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:51:49 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:51:49 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:51:49 user nova-compute[74934]:       <entry name="serial">4e1f21d2-f784-49d3-b2f4-52f0226c048b</entry>
Nov 19 14:51:49 user nova-compute[74934]:       <entry name="uuid">4e1f21d2-f784-49d3-b2f4-52f0226c048b</entry>
Nov 19 14:51:49 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:51:49 user nova-compute[74934]:     </system>
Nov 19 14:51:49 user nova-compute[74934]:   </sysinfo>
Nov 19 14:51:49 user nova-compute[74934]:   <os>
Nov 19 14:51:49 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:51:49 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:51:49 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:51:49 user nova-compute[74934]:   </os>
Nov 19 14:51:49 user nova-compute[74934]:   <features>
Nov 19 14:51:49 user nova-compute[74934]:     <acpi/>
Nov 19 14:51:49 user nova-compute[74934]:     <apic/>
Nov 19 14:51:49 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:51:49 user nova-compute[74934]:   </features>
Nov 19 14:51:49 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:51:49 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:51:49 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:51:49 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:51:49 user nova-compute[74934]:   </clock>
Nov 19 14:51:49 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:51:49 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:51:49 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:51:49 user nova-compute[74934]:   </cpu>
Nov 19 14:51:49 user nova-compute[74934]:   <devices>
Nov 19 14:51:49 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:51:49 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:51:49 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk"/>
Nov 19 14:51:49 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:51:49 user nova-compute[74934]:     </disk>
Nov 19 14:51:49 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:51:49 user nova-compute[74934]:       <mac address="fa:16:3e:61:2a:14"/>
Nov 19 14:51:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:51:49 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:51:49 user nova-compute[74934]:       <target dev="tapd827e47e-90"/>
Nov 19 14:51:49 user nova-compute[74934]:     </interface>
Nov 19 14:51:49 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:51:49 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/console.log" append="off"/>
Nov 19 14:51:49 user nova-compute[74934]:     </serial>
Nov 19 14:51:49 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:51:49 user nova-compute[74934]:     <video>
Nov 19 14:51:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:51:49 user nova-compute[74934]:     </video>
Nov 19 14:51:49 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:51:49 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:51:49 user nova-compute[74934]:     </rng>
Nov 19 14:51:49 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:51:49 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:51:49 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:51:49 user nova-compute[74934]:     </memballoon>
Nov 19 14:51:49 user nova-compute[74934]:   </devices>
Nov 19 14:51:49 user nova-compute[74934]: </domain>
Nov 19 14:51:49 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964213297',display_name='tempest-tempest.common.compute-instance-1964213297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964213297',id=16,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BUBDk+mwq/G25w9oNvmbP7s6FB+a/JpUr7aZTk9Pqcry6VoWsygtGANdxOPdDD1+3EVI+ZkoTIkvxM7DRi4n6FFHnmiarrXth1XJhv1EKmLWhiVBJixe4uk06xQaXxQ==',key_name='tempest-keypair-688273119',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-d3000n5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=4e1f21d2-f784-49d3-b2f4-52f0226c048b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG os_vif [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2888b78-f6f5-5bfe-8537-cac4fbdc1b22', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd827e47e-90, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd827e47e-90, col_values=(('qos', UUID('0d4ce8fc-4590-495a-b8a7-91ade868b988')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd827e47e-90, col_values=(('external_ids', {'iface-id': 'd827e47e-9033-4f04-9987-837c6460c55a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:2a:14', 'vm-uuid': '4e1f21d2-f784-49d3-b2f4-52f0226c048b'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:49 user nova-compute[74934]: INFO os_vif [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90')
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No VIF found with MAC fa:16:3e:61:2a:14, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updated VIF entry in instance network info cache for port d827e47e-9033-4f04-9987-837c6460c55a. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating instance_info_cache with network_info: [{"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bdf541aa-1118-4ac1-917f-66106eddd579 req-4a52aac8-9307-40bc-9db1-e2d484fd1611 service nova] Releasing lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-511cd3b3-888d-4b5d-8e41-4cbb8a677ba4 req-2308e59b-a1b7-4e83-b702-51e7e037ac32 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-511cd3b3-888d-4b5d-8e41-4cbb8a677ba4 req-2308e59b-a1b7-4e83-b702-51e7e037ac32 service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-511cd3b3-888d-4b5d-8e41-4cbb8a677ba4 req-2308e59b-a1b7-4e83-b702-51e7e037ac32 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-511cd3b3-888d-4b5d-8e41-4cbb8a677ba4 req-2308e59b-a1b7-4e83-b702-51e7e037ac32 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-511cd3b3-888d-4b5d-8e41-4cbb8a677ba4 req-2308e59b-a1b7-4e83-b702-51e7e037ac32 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:51 user nova-compute[74934]: WARNING nova.compute.manager [req-511cd3b3-888d-4b5d-8e41-4cbb8a677ba4 req-2308e59b-a1b7-4e83-b702-51e7e037ac32 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state building and task_state spawning.
Nov 19 14:51:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:51:51 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-e587b15e-1c63-4f24-aa79-0afe4417b5d1 req-356a206c-13da-4c1f-b4b8-6b6e31d73395 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e587b15e-1c63-4f24-aa79-0afe4417b5d1 req-356a206c-13da-4c1f-b4b8-6b6e31d73395 service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e587b15e-1c63-4f24-aa79-0afe4417b5d1 req-356a206c-13da-4c1f-b4b8-6b6e31d73395 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e587b15e-1c63-4f24-aa79-0afe4417b5d1 req-356a206c-13da-4c1f-b4b8-6b6e31d73395 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-e587b15e-1c63-4f24-aa79-0afe4417b5d1 req-356a206c-13da-4c1f-b4b8-6b6e31d73395 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:53 user nova-compute[74934]: WARNING nova.compute.manager [req-e587b15e-1c63-4f24-aa79-0afe4417b5d1 req-356a206c-13da-4c1f-b4b8-6b6e31d73395 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state building and task_state spawning.
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:51:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance spawned successfully.
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:51:53 user nova-compute[74934]: INFO nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 19 14:51:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:53 user nova-compute[74934]: INFO nova.compute.manager [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Took 7.57 seconds to build instance.
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9f1d849a-80f9-4f5e-b439-e7bf3e723f9d tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.714s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:55 user nova-compute[74934]: INFO nova.compute.manager [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Terminating instance
Nov 19 14:51:55 user nova-compute[74934]: DEBUG nova.compute.manager [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.compute.manager [req-b77ac801-a397-4c2a-ad9b-c44ebd077f9f req-a8fbb854-4fb0-485f-ba0e-974117a0adfe service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-unplugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b77ac801-a397-4c2a-ad9b-c44ebd077f9f req-a8fbb854-4fb0-485f-ba0e-974117a0adfe service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b77ac801-a397-4c2a-ad9b-c44ebd077f9f req-a8fbb854-4fb0-485f-ba0e-974117a0adfe service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b77ac801-a397-4c2a-ad9b-c44ebd077f9f req-a8fbb854-4fb0-485f-ba0e-974117a0adfe service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.compute.manager [req-b77ac801-a397-4c2a-ad9b-c44ebd077f9f req-a8fbb854-4fb0-485f-ba0e-974117a0adfe service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-unplugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.compute.manager [req-b77ac801-a397-4c2a-ad9b-c44ebd077f9f req-a8fbb854-4fb0-485f-ba0e-974117a0adfe service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-unplugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:51:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Instance destroyed successfully.
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.objects.instance [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lazy-loading 'resources' on Instance uuid b7614315-a839-4dbf-8137-9b4a096bea5b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-19T14:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021700031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021700031',id=8,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmHSzKnxJJg2O4PNfV1yybUml/zr0BvWMK9VN2BRT2muNJNYh7f3YLqUv7/7IiJto1diHH5iItBO1OoJfvbf6jb9NCTgJZgZs2V2IlRBpswcTUtTeHgcQ8U8e6FhM3KOw==',key_name='tempest-keypair-853813354',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5463253de6814508960ba3cd7514bb77',ramdisk_id='',reservation_id='r-2ku31qu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-246323927',owner_user_name='tempest-TaggedAttachmentsTest-246323927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5575961a25d9487ab557835abe15c460',uuid=b7614315-a839-4dbf-8137-9b4a096bea5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converting VIF {"id": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "address": "fa:16:3e:7d:a1:30", "network": {"id": "8c382084-8b96-42a5-8c3e-f07ff84303ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-311523344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5463253de6814508960ba3cd7514bb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f638f7-1e", "ovs_interfaceid": "99f638f7-1e8c-4ae1-b4ed-c6a438e703f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG os_vif [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99f638f7-1e, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0013eb87-ad68-4ce2-86eb-131b721493e0) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:51:56 user nova-compute[74934]: INFO os_vif [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:a1:30,bridge_name='br-int',has_traffic_filtering=True,id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4,network=Network(8c382084-8b96-42a5-8c3e-f07ff84303ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f638f7-1e')
Nov 19 14:51:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Deleting instance files /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b_del
Nov 19 14:51:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Deletion of /opt/stack/data/nova/instances/b7614315-a839-4dbf-8137-9b4a096bea5b_del complete
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:56 user nova-compute[74934]: INFO nova.compute.manager [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-cdc6752c-f08c-4e1f-99ca-f69bbac4a545 req-d1934140-dd44-4037-99e0-ce5f49b4cb87 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-deleted-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:57 user nova-compute[74934]: INFO nova.compute.manager [req-cdc6752c-f08c-4e1f-99ca-f69bbac4a545 req-d1934140-dd44-4037-99e0-ce5f49b4cb87 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Neutron deleted interface 99f638f7-1e8c-4ae1-b4ed-c6a438e703f4; detaching it from the instance and deleting it from the info cache
Nov 19 14:51:57 user nova-compute[74934]: DEBUG nova.network.neutron [req-cdc6752c-f08c-4e1f-99ca-f69bbac4a545 req-d1934140-dd44-4037-99e0-ce5f49b4cb87 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:51:57 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:57 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:51:57 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7870MB free_disk=25.462825775146484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:57 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Took 1.53 seconds to deallocate network for instance.
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-cdc6752c-f08c-4e1f-99ca-f69bbac4a545 req-d1934140-dd44-4037-99e0-ce5f49b4cb87 service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Detach interface failed, port_id=99f638f7-1e8c-4ae1-b4ed-c6a438e703f4, reason: Instance b7614315-a839-4dbf-8137-9b4a096bea5b could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 8b33af6a-67df-485c-84d9-ce224f78e67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b7614315-a839-4dbf-8137-9b4a096bea5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60dddb96-ee81-4cc8-8960-7e0189d4543b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 454533ea-062a-4638-bd8a-72091c6106cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-402f572c-44ff-431b-a808-756e4b13440c req-642727b9-fac3-405c-9888-faab4045c8db service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received event network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-402f572c-44ff-431b-a808-756e4b13440c req-642727b9-fac3-405c-9888-faab4045c8db service nova] Acquiring lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-402f572c-44ff-431b-a808-756e4b13440c req-642727b9-fac3-405c-9888-faab4045c8db service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-402f572c-44ff-431b-a808-756e4b13440c req-642727b9-fac3-405c-9888-faab4045c8db service nova] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-402f572c-44ff-431b-a808-756e4b13440c req-642727b9-fac3-405c-9888-faab4045c8db service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] No waiting events found dispatching network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:51:58 user nova-compute[74934]: WARNING nova.compute.manager [req-402f572c-44ff-431b-a808-756e4b13440c req-642727b9-fac3-405c-9888-faab4045c8db service nova] [instance: b7614315-a839-4dbf-8137-9b4a096bea5b] Received unexpected event network-vif-plugged-99f638f7-1e8c-4ae1-b4ed-c6a438e703f4 for instance with vm_state deleted and task_state None.
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.551s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:59 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Deleted allocations for instance b7614315-a839-4dbf-8137-9b4a096bea5b
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-304af47e-381a-4e22-b7ae-fb269aabae1a tempest-TaggedAttachmentsTest-246323927 tempest-TaggedAttachmentsTest-246323927-project-member] Lock "b7614315-a839-4dbf-8137-9b4a096bea5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.910s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:51:59 user nova-compute[74934]: INFO nova.compute.manager [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Unshelving
Nov 19 14:51:59 user nova-compute[74934]: INFO nova.virt.block_device [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Booting with volume 2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc at /dev/vdc
Nov 19 14:51:59 user nova-compute[74934]: DEBUG os_brick.utils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e009a9c-f04f-4d53-bfa4-3ac780bdea72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c985b0f8-4398-4bf0-8671-a43a5404ccc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2cce6f-7369-46b7-b549-2267398c4450]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4903be-fab7-4f51-be81-ca3c57c340fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:51:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:52:00 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1479f3c3-db03-4db7-819c-759bfacc5119]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG os_brick.utils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating existing volume attachment record: a08cf7f1-d59e-4ca7-803d-9a059937e411 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:00 user nova-compute[74934]: INFO nova.compute.manager [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Terminating instance
Nov 19 14:52:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Instance destroyed successfully.
Nov 19 14:52:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lazy-loading 'resources' on Instance uuid 60dddb96-ee81-4cc8-8960-7e0189d4543b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-821473053',display_name='tempest-TestVolumeSwap-server-821473053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-821473053',id=9,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWVmU5HP3zWRUozy3jQq9bASJyjx/3Oq2HlkLYwAfhZ+Tq3iQg5SIcsEHy59OGcoNIbM+EL0vjaCPjjYQPrUglDFqstjOyZwuSvbw1tJJziRuvOI0lMYu1z27PWXONnHA==',key_name='tempest-keypair-1796979662',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='307424c45f2441cea52f6a6474184e9a',ramdisk_id='',reservation_id='r-cejmkbur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-521432732',owner_user_name='tempest-TestVolumeSwap-521432732-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e49caa51459e4cd7a48fec02749c59e4',uuid=60dddb96-ee81-4cc8-8960-7e0189d4543b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Converting VIF {"id": "717622fa-a1ff-4988-9e16-f399ba8f9020", "address": "fa:16:3e:09:58:ef", "network": {"id": "cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1970714582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "307424c45f2441cea52f6a6474184e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717622fa-a1", "ovs_interfaceid": "717622fa-a1ff-4988-9e16-f399ba8f9020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG os_vif [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717622fa-a1, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c0dcea2-a880-4cb4-86a9-f6a6f137cbaa) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:00 user nova-compute[74934]: INFO os_vif [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:58:ef,bridge_name='br-int',has_traffic_filtering=True,id=717622fa-a1ff-4988-9e16-f399ba8f9020,network=Network(cf1c45b9-2e3a-44b8-9fd7-91b3af8cdeb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717622fa-a1')
Nov 19 14:52:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Deleting instance files /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b_del
Nov 19 14:52:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Deletion of /opt/stack/data/nova/instances/60dddb96-ee81-4cc8-8960-7e0189d4543b_del complete
Nov 19 14:52:01 user nova-compute[74934]: INFO nova.compute.manager [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 19 14:52:01 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-49586024-c38a-4586-ae05-04f5eccebfe6 req-518cfcb5-17ba-490c-a257-e9bb977fe9e3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-vif-unplugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49586024-c38a-4586-ae05-04f5eccebfe6 req-518cfcb5-17ba-490c-a257-e9bb977fe9e3 service nova] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49586024-c38a-4586-ae05-04f5eccebfe6 req-518cfcb5-17ba-490c-a257-e9bb977fe9e3 service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49586024-c38a-4586-ae05-04f5eccebfe6 req-518cfcb5-17ba-490c-a257-e9bb977fe9e3 service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-49586024-c38a-4586-ae05-04f5eccebfe6 req-518cfcb5-17ba-490c-a257-e9bb977fe9e3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] No waiting events found dispatching network-vif-unplugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-49586024-c38a-4586-ae05-04f5eccebfe6 req-518cfcb5-17ba-490c-a257-e9bb977fe9e3 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-vif-unplugged-717622fa-a1ff-4988-9e16-f399ba8f9020 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:01 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Took 0.87 seconds to deallocate network for instance.
Nov 19 14:52:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-d0023a33-16f8-4454-b1d2-55e422441f34 req-f0f35230-b2c3-41ab-be99-826a732c6b57 service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-vif-deleted-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:02 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:52:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:52:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:02 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Deleted allocations for instance 60dddb96-ee81-4cc8-8960-7e0189d4543b
Nov 19 14:52:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fe31ff62-1e99-416e-8347-32c604969515 tempest-TestVolumeSwap-521432732 tempest-TestVolumeSwap-521432732-project-member] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-307fc404-dce5-449e-b987-c7c63644677e req-6262d973-419b-429a-ade8-9f323ba2dd9e service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received event network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-307fc404-dce5-449e-b987-c7c63644677e req-6262d973-419b-429a-ade8-9f323ba2dd9e service nova] Acquiring lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-307fc404-dce5-449e-b987-c7c63644677e req-6262d973-419b-429a-ade8-9f323ba2dd9e service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-307fc404-dce5-449e-b987-c7c63644677e req-6262d973-419b-429a-ade8-9f323ba2dd9e service nova] Lock "60dddb96-ee81-4cc8-8960-7e0189d4543b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-307fc404-dce5-449e-b987-c7c63644677e req-6262d973-419b-429a-ade8-9f323ba2dd9e service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] No waiting events found dispatching network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:03 user nova-compute[74934]: WARNING nova.compute.manager [req-307fc404-dce5-449e-b987-c7c63644677e req-6262d973-419b-429a-ade8-9f323ba2dd9e service nova] [instance: 60dddb96-ee81-4cc8-8960-7e0189d4543b] Received unexpected event network-vif-plugged-717622fa-a1ff-4988-9e16-f399ba8f9020 for instance with vm_state deleted and task_state None.
Nov 19 14:52:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:52:07 user nova-compute[74934]: INFO nova.compute.claims [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Claim successful on node user
Nov 19 14:52:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:52:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:52:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:52:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG nova.policy [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c51fecd683c4f249231992e80b25bcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c1ab85f9cb45d498a89a0fc604c365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:52:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Creating image(s)
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "/opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "/opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk 1073741824" returned: 0 in 0.072s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Successfully created port: bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.220s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:52:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Cannot resize image /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Ensure instance console log exists: /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Successfully updated port: bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "refresh_cache-4f62bc02-37c5-46f6-a965-c39399ddd813" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquired lock "refresh_cache-4f62bc02-37c5-46f6-a965-c39399ddd813" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-changed-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Refreshing instance network info cache due to event network-changed-bcce1af0-d412-4a2f-a585-f293ef3a015b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] Acquiring lock "refresh_cache-4f62bc02-37c5-46f6-a965-c39399ddd813" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Updating instance_info_cache with network_info: [{"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Releasing lock "refresh_cache-4f62bc02-37c5-46f6-a965-c39399ddd813" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Instance network_info: |[{"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] Acquired lock "refresh_cache-4f62bc02-37c5-46f6-a965-c39399ddd813" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Refreshing network info cache for port bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:52:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Start _get_guest_xml network_info=[{"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:52:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1659398234',display_name='tempest-DeleteServersTestJSON-server-1659398234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1659398234',id=17,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3c1ab85f9cb45d498a89a0fc604c365',ramdisk_id='',reservation_id='r-5hs8f35l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1374428341',owner_user_name='tempest-DeleteServersTestJSON-1374428341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:08Z,user_data=None,user_id='7c51fecd683c4f249231992e80b25bcc',uuid=4f62bc02-37c5-46f6-a965-c39399ddd813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Converting VIF {"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f62bc02-37c5-46f6-a965-c39399ddd813 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:52:10 user nova-compute[74934]:   <uuid>4f62bc02-37c5-46f6-a965-c39399ddd813</uuid>
Nov 19 14:52:10 user nova-compute[74934]:   <name>instance-00000011</name>
Nov 19 14:52:10 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:52:10 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:52:10 user nova-compute[74934]:   <metadata>
Nov 19 14:52:10 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:52:10 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:52:10 user nova-compute[74934]:       <nova:name>tempest-DeleteServersTestJSON-server-1659398234</nova:name>
Nov 19 14:52:10 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:52:09</nova:creationTime>
Nov 19 14:52:10 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:52:10 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:52:10 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:52:10 user nova-compute[74934]:       <nova:owner>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:user uuid="7c51fecd683c4f249231992e80b25bcc">tempest-DeleteServersTestJSON-1374428341-project-member</nova:user>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:project uuid="e3c1ab85f9cb45d498a89a0fc604c365">tempest-DeleteServersTestJSON-1374428341</nova:project>
Nov 19 14:52:10 user nova-compute[74934]:       </nova:owner>
Nov 19 14:52:10 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:52:10 user nova-compute[74934]:       <nova:ports>
Nov 19 14:52:10 user nova-compute[74934]:         <nova:port uuid="bcce1af0-d412-4a2f-a585-f293ef3a015b">
Nov 19 14:52:10 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 19 14:52:10 user nova-compute[74934]:         </nova:port>
Nov 19 14:52:10 user nova-compute[74934]:       </nova:ports>
Nov 19 14:52:10 user nova-compute[74934]:     </nova:instance>
Nov 19 14:52:10 user nova-compute[74934]:   </metadata>
Nov 19 14:52:10 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:52:10 user nova-compute[74934]:     <system>
Nov 19 14:52:10 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:52:10 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:52:10 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:52:10 user nova-compute[74934]:       <entry name="serial">4f62bc02-37c5-46f6-a965-c39399ddd813</entry>
Nov 19 14:52:10 user nova-compute[74934]:       <entry name="uuid">4f62bc02-37c5-46f6-a965-c39399ddd813</entry>
Nov 19 14:52:10 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:52:10 user nova-compute[74934]:     </system>
Nov 19 14:52:10 user nova-compute[74934]:   </sysinfo>
Nov 19 14:52:10 user nova-compute[74934]:   <os>
Nov 19 14:52:10 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:52:10 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:52:10 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:52:10 user nova-compute[74934]:   </os>
Nov 19 14:52:10 user nova-compute[74934]:   <features>
Nov 19 14:52:10 user nova-compute[74934]:     <acpi/>
Nov 19 14:52:10 user nova-compute[74934]:     <apic/>
Nov 19 14:52:10 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:52:10 user nova-compute[74934]:   </features>
Nov 19 14:52:10 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:52:10 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:52:10 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:52:10 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:52:10 user nova-compute[74934]:   </clock>
Nov 19 14:52:10 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:52:10 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:52:10 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:52:10 user nova-compute[74934]:   </cpu>
Nov 19 14:52:10 user nova-compute[74934]:   <devices>
Nov 19 14:52:10 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:10 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:10 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk"/>
Nov 19 14:52:10 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:52:10 user nova-compute[74934]:     </disk>
Nov 19 14:52:10 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:52:10 user nova-compute[74934]:       <mac address="fa:16:3e:2d:a7:4c"/>
Nov 19 14:52:10 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:10 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:52:10 user nova-compute[74934]:       <target dev="tapbcce1af0-d4"/>
Nov 19 14:52:10 user nova-compute[74934]:     </interface>
Nov 19 14:52:10 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:52:10 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/console.log" append="off"/>
Nov 19 14:52:10 user nova-compute[74934]:     </serial>
Nov 19 14:52:10 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:52:10 user nova-compute[74934]:     <video>
Nov 19 14:52:10 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:10 user nova-compute[74934]:     </video>
Nov 19 14:52:10 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:52:10 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:52:10 user nova-compute[74934]:     </rng>
Nov 19 14:52:10 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:52:10 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:52:10 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:52:10 user nova-compute[74934]:     </memballoon>
Nov 19 14:52:10 user nova-compute[74934]:   </devices>
Nov 19 14:52:10 user nova-compute[74934]: </domain>
Nov 19 14:52:10 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1659398234',display_name='tempest-DeleteServersTestJSON-server-1659398234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1659398234',id=17,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3c1ab85f9cb45d498a89a0fc604c365',ramdisk_id='',reservation_id='r-5hs8f35l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1374428341',owner_user_name='tempest-DeleteServersTestJSON-1374428341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:08Z,user_data=None,user_id='7c51fecd683c4f249231992e80b25bcc',uuid=4f62bc02-37c5-46f6-a965-c39399ddd813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Converting VIF {"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG os_vif [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a4336d5-2145-5b2e-b70e-9bd6cdf37164', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcce1af0-d4, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcce1af0-d4, col_values=(('qos', UUID('a61e6f64-3a04-4c17-bafa-935477b7fccf')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcce1af0-d4, col_values=(('external_ids', {'iface-id': 'bcce1af0-d412-4a2f-a585-f293ef3a015b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:a7:4c', 'vm-uuid': '4f62bc02-37c5-46f6-a965-c39399ddd813'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:10 user nova-compute[74934]: INFO os_vif [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4')
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] No VIF found with MAC fa:16:3e:2d:a7:4c, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'pci_requests' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'numa_topology' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:52:10 user nova-compute[74934]: INFO nova.compute.claims [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Claim successful on node user
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Updated VIF entry in instance network info cache for port bcce1af0-d412-4a2f-a585-f293ef3a015b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Updating instance_info_cache with network_info: [{"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dc0080bf-93e0-4717-be14-d5fd6da4712a req-0377bda4-062e-4437-9b99-33b842133642 service nova] Releasing lock "refresh_cache-4f62bc02-37c5-46f6-a965-c39399ddd813" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:10 user nova-compute[74934]: INFO nova.network.neutron [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating port 0cd621cf-48bb-4332-9f77-72fd63bf014b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing instance network info cache due to event network-changed-0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:52:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Creating image(s)
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Refreshing network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.objects.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<4eb838ad-d995-407b-ab5a-b8dc8df9a60e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "d83f0421bce8e3e39820db43d3a6707c01c961cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "d83f0421bce8e3e39820db43d3a6707c01c961cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:52:12 user nova-compute[74934]: INFO nova.compute.claims [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Claim successful on node user
Nov 19 14:52:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.part --force-share --output=json" returned: 0 in 0.227s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:13 user nova-compute[74934]: DEBUG nova.virt.images [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] f9c4daa1-1512-4d63-93bc-ad0dc89189ce was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:52:13 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:52:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.part /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] No waiting events found dispatching network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:14 user nova-compute[74934]: WARNING nova.compute.manager [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received unexpected event network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b for instance with vm_state building and task_state spawning.
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] No waiting events found dispatching network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:14 user nova-compute[74934]: WARNING nova.compute.manager [req-7215a0e0-9081-4b11-8e8a-f2577a1fcec9 req-1123b8ee-6907-45ca-827d-68667fa0906c service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received unexpected event network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b for instance with vm_state building and task_state spawning.
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updated VIF entry in instance network info cache for port 0cd621cf-48bb-4332-9f77-72fd63bf014b. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9fd06b2-023d-4179-97b5-a591da33f57e req-5942932e-f8f7-43cd-a7c8-771aee811658 service nova] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.part /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.converted" returned: 0 in 0.419s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Instance spawned successfully.
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.950s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:52:14 user nova-compute[74934]: INFO nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:52:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc.converted --force-share --output=json" returned: 0 in 0.271s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "d83f0421bce8e3e39820db43d3a6707c01c961cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.061s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:14 user nova-compute[74934]: INFO nova.compute.manager [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Took 7.25 seconds to build instance.
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4e1ecee9-6500-4b0f-8d5e-dd6fe67d103e tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.399s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.policy [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c76ed73a0da4b2f8b6cf6022eb357d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f5e39f366f4f78aa258740eb0f0fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "d83f0421bce8e3e39820db43d3a6707c01c961cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "d83f0421bce8e3e39820db43d3a6707c01c961cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:52:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Creating image(s)
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "9fb27858861f73099b4f5c369cb7f74dd23b55ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "9fb27858861f73099b4f5c369cb7f74dd23b55ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Successfully created port: 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc --force-share --output=json" returned: 0 in 0.629s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc,backing_fmt=raw /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc,backing_fmt=raw /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk 1073741824" returned: 0 in 0.052s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "d83f0421bce8e3e39820db43d3a6707c01c961cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.688s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.part --force-share --output=json" returned: 0 in 0.206s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG nova.virt.images [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] 9959537f-405f-458f-ba5a-6f1f5e948203 was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.part /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'migration_context' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG nova.objects.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<4eb838ad-d995-407b-ab5a-b8dc8df9a60e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Rebasing disk image.
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df -F raw /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.part /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.converted" returned: 0 in 0.378s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Successfully updated port: 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "9fb27858861f73099b4f5c369cb7f74dd23b55ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.323s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-changed-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing instance network info cache due to event network-changed-469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json" returned: 0 in 0.392s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "9fb27858861f73099b4f5c369cb7f74dd23b55ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "9fb27858861f73099b4f5c369cb7f74dd23b55ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance network_info: |[{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG nova.network.neutron [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json" returned: 0 in 0.211s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab,backing_fmt=raw /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab,backing_fmt=raw /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk 1073741824" returned: 0 in 0.069s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "9fb27858861f73099b4f5c369cb7f74dd23b55ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Cannot resize image /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Ensure instance console log exists: /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Start _get_guest_xml network_info=[{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:52:09Z,direct_url=<?>,disk_format='qcow2',id=9959537f-405f-458f-ba5a-6f1f5e948203,min_disk=0,min_ram=0,name='tempest-scenario-img--1757914187',owner='11f5e39f366f4f78aa258740eb0f0fae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:52:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '9959537f-405f-458f-ba5a-6f1f5e948203'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:52:17 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:17 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:52:09Z,direct_url=<?>,disk_format='qcow2',id=9959537f-405f-458f-ba5a-6f1f5e948203,min_disk=0,min_ram=0,name='tempest-scenario-img--1757914187',owner='11f5e39f366f4f78aa258740eb0f0fae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:52:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020451631',display_name='tempest-TestMinimumBasicScenario-server-2020451631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020451631',id=18,image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPtF8JoIZC0ogO5nssLwdJYOBPPqpTDNBB0Ox0buLQsOyh7QyME+jgiWq2dcAo/ewyMXh6xaxZnybVWDGcALXuhXW5WyuIBR+XV3tM3QHLbjsRDoRrDLz3ZgXVSb4Oa9w==',key_name='tempest-TestMinimumBasicScenario-489823040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-5ps226ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:15Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=fee595d0-5f2c-4e12-8806-b28e02675c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'pci_devices' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:52:17 user nova-compute[74934]:   <uuid>fee595d0-5f2c-4e12-8806-b28e02675c74</uuid>
Nov 19 14:52:17 user nova-compute[74934]:   <name>instance-00000012</name>
Nov 19 14:52:17 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:52:17 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:52:17 user nova-compute[74934]:   <metadata>
Nov 19 14:52:17 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:52:17 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:52:17 user nova-compute[74934]:       <nova:name>tempest-TestMinimumBasicScenario-server-2020451631</nova:name>
Nov 19 14:52:17 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:52:17</nova:creationTime>
Nov 19 14:52:17 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:52:17 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:52:17 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:52:17 user nova-compute[74934]:       <nova:owner>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:user uuid="6c76ed73a0da4b2f8b6cf6022eb357d6">tempest-TestMinimumBasicScenario-2055579736-project-member</nova:user>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:project uuid="11f5e39f366f4f78aa258740eb0f0fae">tempest-TestMinimumBasicScenario-2055579736</nova:project>
Nov 19 14:52:17 user nova-compute[74934]:       </nova:owner>
Nov 19 14:52:17 user nova-compute[74934]:       <nova:root type="image" uuid="9959537f-405f-458f-ba5a-6f1f5e948203"/>
Nov 19 14:52:17 user nova-compute[74934]:       <nova:ports>
Nov 19 14:52:17 user nova-compute[74934]:         <nova:port uuid="469efd39-a7d3-4ba1-a81e-105842842227">
Nov 19 14:52:17 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 19 14:52:17 user nova-compute[74934]:         </nova:port>
Nov 19 14:52:17 user nova-compute[74934]:       </nova:ports>
Nov 19 14:52:17 user nova-compute[74934]:     </nova:instance>
Nov 19 14:52:17 user nova-compute[74934]:   </metadata>
Nov 19 14:52:17 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:52:17 user nova-compute[74934]:     <system>
Nov 19 14:52:17 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:52:17 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:52:17 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:52:17 user nova-compute[74934]:       <entry name="serial">fee595d0-5f2c-4e12-8806-b28e02675c74</entry>
Nov 19 14:52:17 user nova-compute[74934]:       <entry name="uuid">fee595d0-5f2c-4e12-8806-b28e02675c74</entry>
Nov 19 14:52:17 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:52:17 user nova-compute[74934]:     </system>
Nov 19 14:52:17 user nova-compute[74934]:   </sysinfo>
Nov 19 14:52:17 user nova-compute[74934]:   <os>
Nov 19 14:52:17 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:52:17 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:52:17 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:52:17 user nova-compute[74934]:   </os>
Nov 19 14:52:17 user nova-compute[74934]:   <features>
Nov 19 14:52:17 user nova-compute[74934]:     <acpi/>
Nov 19 14:52:17 user nova-compute[74934]:     <apic/>
Nov 19 14:52:17 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:52:17 user nova-compute[74934]:   </features>
Nov 19 14:52:17 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:52:17 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:52:17 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:52:17 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:52:17 user nova-compute[74934]:   </clock>
Nov 19 14:52:17 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:52:17 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:52:17 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:52:17 user nova-compute[74934]:   </cpu>
Nov 19 14:52:17 user nova-compute[74934]:   <devices>
Nov 19 14:52:17 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:17 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:17 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk"/>
Nov 19 14:52:17 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:52:17 user nova-compute[74934]:     </disk>
Nov 19 14:52:17 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:52:17 user nova-compute[74934]:       <mac address="fa:16:3e:17:b2:72"/>
Nov 19 14:52:17 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:17 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:52:17 user nova-compute[74934]:       <target dev="tap469efd39-a7"/>
Nov 19 14:52:17 user nova-compute[74934]:     </interface>
Nov 19 14:52:17 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:52:17 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/console.log" append="off"/>
Nov 19 14:52:17 user nova-compute[74934]:     </serial>
Nov 19 14:52:17 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:52:17 user nova-compute[74934]:     <video>
Nov 19 14:52:17 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:17 user nova-compute[74934]:     </video>
Nov 19 14:52:17 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:52:17 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:52:17 user nova-compute[74934]:     </rng>
Nov 19 14:52:17 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:52:17 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:52:17 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:52:17 user nova-compute[74934]:     </memballoon>
Nov 19 14:52:17 user nova-compute[74934]:   </devices>
Nov 19 14:52:17 user nova-compute[74934]: </domain>
Nov 19 14:52:17 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020451631',display_name='tempest-TestMinimumBasicScenario-server-2020451631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020451631',id=18,image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPtF8JoIZC0ogO5nssLwdJYOBPPqpTDNBB0Ox0buLQsOyh7QyME+jgiWq2dcAo/ewyMXh6xaxZnybVWDGcALXuhXW5WyuIBR+XV3tM3QHLbjsRDoRrDLz3ZgXVSb4Oa9w==',key_name='tempest-TestMinimumBasicScenario-489823040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-5ps226ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:15Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=fee595d0-5f2c-4e12-8806-b28e02675c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG os_vif [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updated VIF entry in instance network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fe3cc0a-bda0-5979-81c7-a51061a0fc77', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469efd39-a7, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469efd39-a7, col_values=(('qos', UUID('d98ad115-b75a-4cfd-98cd-d6d02e6899e6')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469efd39-a7, col_values=(('external_ids', {'iface-id': '469efd39-a7d3-4ba1-a81e-105842842227', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:b2:72', 'vm-uuid': 'fee595d0-5f2c-4e12-8806-b28e02675c74'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-791e58a6-1bf1-4e95-a9ba-caac5a666bdd req-1aa7912d-b576-4d95-8cb5-630cef48ac2f service nova] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:17 user nova-compute[74934]: INFO os_vif [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7')
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No VIF found with MAC fa:16:3e:17:b2:72, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df -F raw /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk" returned: 0 in 2.574s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Ensure instance console log exists: /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Start _get_guest_xml network_info=[{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3024744055ac67f3b9afe0fef52607eb',container_format='bare',created_at=2023-11-19T14:50:06Z,direct_url=<?>,disk_format='qcow2',id=f9c4daa1-1512-4d63-93bc-ad0dc89189ce,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-825075697-shelved',owner='f1735667909d4b3e94e6be7ba9a5ec7f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-19T14:50:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'a08cf7f1-d59e-4ca7-803d-9a059937e411', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunScUzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4eb838ad-d995-407b-ab5a-b8dc8df9a60e', 'attached_at': '', 'detached_at': '', 'volume_id': '2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc', 'serial': '2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc'}, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:52:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3024744055ac67f3b9afe0fef52607eb',container_format='bare',created_at=2023-11-19T14:50:06Z,direct_url=<?>,disk_format='qcow2',id=f9c4daa1-1512-4d63-93bc-ad0dc89189ce,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-825075697-shelved',owner='f1735667909d4b3e94e6be7ba9a5ec7f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-19T14:50:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.objects.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<4eb838ad-d995-407b-ab5a-b8dc8df9a60e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunScUzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:52:18 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:52:18 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:52:18 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3591a1-4e56-473f-9b90-1e75b26f4d5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:52:18 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84edb6c-167d-458a-9b40-0eedd1f22a1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc] added
Nov 19 14:52:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7986c529-9230-4074-a4da-bd301809c223]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d868df-8a4f-4354-b4b0-c2fcddcf3873]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qunScUzT {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qunScUzT" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[52794873-2aa5-46c5-9120-ba0b40ee6c76]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qunScUzT'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23e5ca-75de-422a-a59e-d410b9164059]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dabc81a-5260-4877-8696-697a52efd46f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:52:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:52:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:52:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --login" returned: 0 in 0.215s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453a2dd-117b-41c6-877e-6a8494c2759e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260]
Nov 19 14:52:19 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260] successful.
Nov 19 14:52:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d395ca8f-85ef-45a7-83ae-9b1f830c79f3]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[de381265-c204-4da0-b866-73623e5c4981]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:52:19 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:52:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:52:19 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:52:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.511s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.053s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40c76d-5fea-457e-a314-a7b9eb995b75]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunScUzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ffb3273f-3130-42c6-b95c-ebb50ef37518 req-5e287b5f-d991-4ce5-a711-af5c3e85488b service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ffb3273f-3130-42c6-b95c-ebb50ef37518 req-5e287b5f-d991-4ce5-a711-af5c3e85488b service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ffb3273f-3130-42c6-b95c-ebb50ef37518 req-5e287b5f-d991-4ce5-a711-af5c3e85488b service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ffb3273f-3130-42c6-b95c-ebb50ef37518 req-5e287b5f-d991-4ce5-a711-af5c3e85488b service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ffb3273f-3130-42c6-b95c-ebb50ef37518 req-5e287b5f-d991-4ce5-a711-af5c3e85488b service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:20 user nova-compute[74934]: WARNING nova.compute.manager [req-ffb3273f-3130-42c6-b95c-ebb50ef37518 req-5e287b5f-d991-4ce5-a711-af5c3e85488b service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state building and task_state spawning.
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.598s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] <== connect_volume: return (1600ms) {'type': 'block', 'scsi_wwn': '23836333664623766', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836333664623766', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825075697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825075697',id=5,image_ref='f9c4daa1-1512-4d63-93bc-ad0dc89189ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1600849378',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-qq0f56qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member',shelved_at='2023-11-19T14:50:10.301262',shelved_host='user',shelved_image_id='f9c4daa1-1512-4d63-93bc-ad0dc89189ce'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=4eb838ad-d995-407b-ab5a-b8dc8df9a60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.objects.base [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<4eb838ad-d995-407b-ab5a-b8dc8df9a60e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:52:20 user nova-compute[74934]:   <uuid>4eb838ad-d995-407b-ab5a-b8dc8df9a60e</uuid>
Nov 19 14:52:20 user nova-compute[74934]:   <name>instance-00000005</name>
Nov 19 14:52:20 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:52:20 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:52:20 user nova-compute[74934]:   <metadata>
Nov 19 14:52:20 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:52:20 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:52:20 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-825075697</nova:name>
Nov 19 14:52:20 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:52:18</nova:creationTime>
Nov 19 14:52:20 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:52:20 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:52:20 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:52:20 user nova-compute[74934]:       <nova:owner>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:user uuid="ef44dc0981394f5fb42de977994f483d">tempest-AttachVolumeShelveTestJSON-884997441-project-member</nova:user>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:project uuid="f1735667909d4b3e94e6be7ba9a5ec7f">tempest-AttachVolumeShelveTestJSON-884997441</nova:project>
Nov 19 14:52:20 user nova-compute[74934]:       </nova:owner>
Nov 19 14:52:20 user nova-compute[74934]:       <nova:root type="image" uuid="f9c4daa1-1512-4d63-93bc-ad0dc89189ce"/>
Nov 19 14:52:20 user nova-compute[74934]:       <nova:ports>
Nov 19 14:52:20 user nova-compute[74934]:         <nova:port uuid="0cd621cf-48bb-4332-9f77-72fd63bf014b">
Nov 19 14:52:20 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 19 14:52:20 user nova-compute[74934]:         </nova:port>
Nov 19 14:52:20 user nova-compute[74934]:       </nova:ports>
Nov 19 14:52:20 user nova-compute[74934]:     </nova:instance>
Nov 19 14:52:20 user nova-compute[74934]:   </metadata>
Nov 19 14:52:20 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:52:20 user nova-compute[74934]:     <system>
Nov 19 14:52:20 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:52:20 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:52:20 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:52:20 user nova-compute[74934]:       <entry name="serial">4eb838ad-d995-407b-ab5a-b8dc8df9a60e</entry>
Nov 19 14:52:20 user nova-compute[74934]:       <entry name="uuid">4eb838ad-d995-407b-ab5a-b8dc8df9a60e</entry>
Nov 19 14:52:20 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:52:20 user nova-compute[74934]:     </system>
Nov 19 14:52:20 user nova-compute[74934]:   </sysinfo>
Nov 19 14:52:20 user nova-compute[74934]:   <os>
Nov 19 14:52:20 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:52:20 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:52:20 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:52:20 user nova-compute[74934]:   </os>
Nov 19 14:52:20 user nova-compute[74934]:   <features>
Nov 19 14:52:20 user nova-compute[74934]:     <acpi/>
Nov 19 14:52:20 user nova-compute[74934]:     <apic/>
Nov 19 14:52:20 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:52:20 user nova-compute[74934]:   </features>
Nov 19 14:52:20 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:52:20 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:52:20 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:52:20 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:52:20 user nova-compute[74934]:   </clock>
Nov 19 14:52:20 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:52:20 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:52:20 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:52:20 user nova-compute[74934]:   </cpu>
Nov 19 14:52:20 user nova-compute[74934]:   <devices>
Nov 19 14:52:20 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:20 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:20 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk"/>
Nov 19 14:52:20 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:52:20 user nova-compute[74934]:     </disk>
Nov 19 14:52:20 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:52:20 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:52:20 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 14:52:20 user nova-compute[74934]:       <target dev="vdc" bus="virtio"/>
Nov 19 14:52:20 user nova-compute[74934]:       <serial>2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc</serial>
Nov 19 14:52:20 user nova-compute[74934]:     </disk>
Nov 19 14:52:20 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:52:20 user nova-compute[74934]:       <mac address="fa:16:3e:a8:0b:6b"/>
Nov 19 14:52:20 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:20 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:52:20 user nova-compute[74934]:       <target dev="tap0cd621cf-48"/>
Nov 19 14:52:20 user nova-compute[74934]:     </interface>
Nov 19 14:52:20 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:52:20 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/console.log" append="off"/>
Nov 19 14:52:20 user nova-compute[74934]:     </serial>
Nov 19 14:52:20 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:52:20 user nova-compute[74934]:     <video>
Nov 19 14:52:20 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:20 user nova-compute[74934]:     </video>
Nov 19 14:52:20 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:52:20 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:52:20 user nova-compute[74934]:     </rng>
Nov 19 14:52:20 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:52:20 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:52:20 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:52:20 user nova-compute[74934]:     </memballoon>
Nov 19 14:52:20 user nova-compute[74934]:   </devices>
Nov 19 14:52:20 user nova-compute[74934]: </domain>
Nov 19 14:52:20 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825075697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825075697',id=5,image_ref='f9c4daa1-1512-4d63-93bc-ad0dc89189ce',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1600849378',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-qq0f56qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member',shelved_at='2023-11-19T14:50:10.301262',shelved_host='user',shelved_image_id='f9c4daa1-1512-4d63-93bc-ad0dc89189ce'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=4eb838ad-d995-407b-ab5a-b8dc8df9a60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG os_vif [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7942f3af-ba9b-5447-a9a6-93da35894325', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cd621cf-48, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cd621cf-48, col_values=(('qos', UUID('cc62fc31-2559-4f1c-a9a6-f4d442500c57')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cd621cf-48, col_values=(('external_ids', {'iface-id': '0cd621cf-48bb-4332-9f77-72fd63bf014b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:0b:6b', 'vm-uuid': '4eb838ad-d995-407b-ab5a-b8dc8df9a60e'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:20 user nova-compute[74934]: INFO os_vif [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48')
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No VIF found with MAC fa:16:3e:a8:0b:6b, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:52:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance spawned successfully.
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:21 user nova-compute[74934]: INFO nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 19 14:52:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:52:22 user nova-compute[74934]: INFO nova.compute.manager [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Took 9.48 seconds to build instance.
Nov 19 14:52:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-159cbb43-be05-4939-bdc9-1f594533e6f0 req-4db0f683-c2dc-4f51-989f-5ac5d224800c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-159cbb43-be05-4939-bdc9-1f594533e6f0 req-4db0f683-c2dc-4f51-989f-5ac5d224800c service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-159cbb43-be05-4939-bdc9-1f594533e6f0 req-4db0f683-c2dc-4f51-989f-5ac5d224800c service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-159cbb43-be05-4939-bdc9-1f594533e6f0 req-4db0f683-c2dc-4f51-989f-5ac5d224800c service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-159cbb43-be05-4939-bdc9-1f594533e6f0 req-4db0f683-c2dc-4f51-989f-5ac5d224800c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:22 user nova-compute[74934]: WARNING nova.compute.manager [req-159cbb43-be05-4939-bdc9-1f594533e6f0 req-4db0f683-c2dc-4f51-989f-5ac5d224800c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state None.
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6afa3a8-45c0-4fa5-93ba-4aed7d5c4299 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.610s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-f788b7dc-da4f-444b-9500-9554da66623a req-00942a0f-bc1c-41a4-83bf-b01bda4bfa16 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f788b7dc-da4f-444b-9500-9554da66623a req-00942a0f-bc1c-41a4-83bf-b01bda4bfa16 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f788b7dc-da4f-444b-9500-9554da66623a req-00942a0f-bc1c-41a4-83bf-b01bda4bfa16 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f788b7dc-da4f-444b-9500-9554da66623a req-00942a0f-bc1c-41a4-83bf-b01bda4bfa16 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-f788b7dc-da4f-444b-9500-9554da66623a req-00942a0f-bc1c-41a4-83bf-b01bda4bfa16 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:22 user nova-compute[74934]: WARNING nova.compute.manager [req-f788b7dc-da4f-444b-9500-9554da66623a req-00942a0f-bc1c-41a4-83bf-b01bda4bfa16 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 19 14:52:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:52:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance spawned successfully.
Nov 19 14:52:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-55f71c5a-9618-4746-86e9-d44d2dca36b1 req-eb7eea2b-00a4-402c-b2c0-de2d82907c12 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-55f71c5a-9618-4746-86e9-d44d2dca36b1 req-eb7eea2b-00a4-402c-b2c0-de2d82907c12 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-55f71c5a-9618-4746-86e9-d44d2dca36b1 req-eb7eea2b-00a4-402c-b2c0-de2d82907c12 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-55f71c5a-9618-4746-86e9-d44d2dca36b1 req-eb7eea2b-00a4-402c-b2c0-de2d82907c12 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-55f71c5a-9618-4746-86e9-d44d2dca36b1 req-eb7eea2b-00a4-402c-b2c0-de2d82907c12 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:24 user nova-compute[74934]: WARNING nova.compute.manager [req-55f71c5a-9618-4746-86e9-d44d2dca36b1 req-eb7eea2b-00a4-402c-b2c0-de2d82907c12 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 19 14:52:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:52:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7058baa-f6c5-4195-81ba-99d78a7f6303 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.151s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:52:37 user nova-compute[74934]: INFO nova.compute.claims [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Claim successful on node user
Nov 19 14:52:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:52:37 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:52:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG nova.policy [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '992c2896dd1540d3b8d85928c7125cdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c990d55cb669477a9e76605b29869641', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:52:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Creating image(s)
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.299s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk 1073741824" returned: 0 in 0.068s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.226s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:52:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Successfully created port: d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Cannot resize image /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Ensure instance console log exists: /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Successfully updated port: d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing instance network info cache due to event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.neutron [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance network_info: |[{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Start _get_guest_xml network_info=[{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:52:41 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:41 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-803844216',display_name='tempest-ServerStableDeviceRescueTest-server-803844216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-803844216',id=19,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUbox5HSED7xpC7HcwUxHh/0v35TaeuRy2gcdD681u/N7L38YKqkTpHVLzJoGUNAcIKZPP/OmcGQYj0Ngko9361NpsKRyRpRFAzbO082DLyeyxZ3E1zPTtP7eszn4HUXQ==',key_name='tempest-keypair-1912348231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c990d55cb669477a9e76605b29869641',ramdisk_id='',reservation_id='r-8k3ev66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-183407110',owner_user_name='tempest-ServerStableDeviceRescueTest-183407110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992c2896dd1540d3b8d85928c7125cdb',uuid=7a6dc86f-e21c-4789-9433-34c25d9bf56b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converting VIF {"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.objects.instance [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:52:41 user nova-compute[74934]:   <uuid>7a6dc86f-e21c-4789-9433-34c25d9bf56b</uuid>
Nov 19 14:52:41 user nova-compute[74934]:   <name>instance-00000013</name>
Nov 19 14:52:41 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:52:41 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:52:41 user nova-compute[74934]:   <metadata>
Nov 19 14:52:41 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:52:41 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:52:41 user nova-compute[74934]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-803844216</nova:name>
Nov 19 14:52:41 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:52:41</nova:creationTime>
Nov 19 14:52:41 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:52:41 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:52:41 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:52:41 user nova-compute[74934]:       <nova:owner>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:user uuid="992c2896dd1540d3b8d85928c7125cdb">tempest-ServerStableDeviceRescueTest-183407110-project-member</nova:user>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:project uuid="c990d55cb669477a9e76605b29869641">tempest-ServerStableDeviceRescueTest-183407110</nova:project>
Nov 19 14:52:41 user nova-compute[74934]:       </nova:owner>
Nov 19 14:52:41 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:52:41 user nova-compute[74934]:       <nova:ports>
Nov 19 14:52:41 user nova-compute[74934]:         <nova:port uuid="d8a80afc-d141-4ca8-a0b3-b0374f579f17">
Nov 19 14:52:41 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:52:41 user nova-compute[74934]:         </nova:port>
Nov 19 14:52:41 user nova-compute[74934]:       </nova:ports>
Nov 19 14:52:41 user nova-compute[74934]:     </nova:instance>
Nov 19 14:52:41 user nova-compute[74934]:   </metadata>
Nov 19 14:52:41 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:52:41 user nova-compute[74934]:     <system>
Nov 19 14:52:41 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:52:41 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:52:41 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:52:41 user nova-compute[74934]:       <entry name="serial">7a6dc86f-e21c-4789-9433-34c25d9bf56b</entry>
Nov 19 14:52:41 user nova-compute[74934]:       <entry name="uuid">7a6dc86f-e21c-4789-9433-34c25d9bf56b</entry>
Nov 19 14:52:41 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:52:41 user nova-compute[74934]:     </system>
Nov 19 14:52:41 user nova-compute[74934]:   </sysinfo>
Nov 19 14:52:41 user nova-compute[74934]:   <os>
Nov 19 14:52:41 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:52:41 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:52:41 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:52:41 user nova-compute[74934]:   </os>
Nov 19 14:52:41 user nova-compute[74934]:   <features>
Nov 19 14:52:41 user nova-compute[74934]:     <acpi/>
Nov 19 14:52:41 user nova-compute[74934]:     <apic/>
Nov 19 14:52:41 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:52:41 user nova-compute[74934]:   </features>
Nov 19 14:52:41 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:52:41 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:52:41 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:52:41 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:52:41 user nova-compute[74934]:   </clock>
Nov 19 14:52:41 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:52:41 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:52:41 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:52:41 user nova-compute[74934]:   </cpu>
Nov 19 14:52:41 user nova-compute[74934]:   <devices>
Nov 19 14:52:41 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:41 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:41 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk"/>
Nov 19 14:52:41 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:52:41 user nova-compute[74934]:     </disk>
Nov 19 14:52:41 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:52:41 user nova-compute[74934]:       <mac address="fa:16:3e:ac:cf:bf"/>
Nov 19 14:52:41 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:41 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:52:41 user nova-compute[74934]:       <target dev="tapd8a80afc-d1"/>
Nov 19 14:52:41 user nova-compute[74934]:     </interface>
Nov 19 14:52:41 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:52:41 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/console.log" append="off"/>
Nov 19 14:52:41 user nova-compute[74934]:     </serial>
Nov 19 14:52:41 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:52:41 user nova-compute[74934]:     <video>
Nov 19 14:52:41 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:41 user nova-compute[74934]:     </video>
Nov 19 14:52:41 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:52:41 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:52:41 user nova-compute[74934]:     </rng>
Nov 19 14:52:41 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:52:41 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:52:41 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:52:41 user nova-compute[74934]:     </memballoon>
Nov 19 14:52:41 user nova-compute[74934]:   </devices>
Nov 19 14:52:41 user nova-compute[74934]: </domain>
Nov 19 14:52:41 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-803844216',display_name='tempest-ServerStableDeviceRescueTest-server-803844216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-803844216',id=19,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUbox5HSED7xpC7HcwUxHh/0v35TaeuRy2gcdD681u/N7L38YKqkTpHVLzJoGUNAcIKZPP/OmcGQYj0Ngko9361NpsKRyRpRFAzbO082DLyeyxZ3E1zPTtP7eszn4HUXQ==',key_name='tempest-keypair-1912348231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c990d55cb669477a9e76605b29869641',ramdisk_id='',reservation_id='r-8k3ev66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-183407110',owner_user_name='tempest-ServerStableDeviceRescueTest-183407110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:52:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992c2896dd1540d3b8d85928c7125cdb',uuid=7a6dc86f-e21c-4789-9433-34c25d9bf56b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converting VIF {"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG os_vif [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f53551-a308-532f-b5fa-76322c070e19', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8a80afc-d1, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8a80afc-d1, col_values=(('qos', UUID('c8bb4eda-ec0e-485b-a484-2bfa7545ff90')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8a80afc-d1, col_values=(('external_ids', {'iface-id': 'd8a80afc-d141-4ca8-a0b3-b0374f579f17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:cf:bf', 'vm-uuid': '7a6dc86f-e21c-4789-9433-34c25d9bf56b'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:41 user nova-compute[74934]: INFO os_vif [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1')
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No VIF found with MAC fa:16:3e:ac:cf:bf, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updated VIF entry in instance network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9ed1b119-0c4f-42b3-9298-ea1830e1921a req-8690d86c-95c9-48fc-a29f-aa1cc968da35 service nova] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-1b0627af-2714-4c0c-9694-adeb9c85bc63 req-57531b1b-b5b7-42ea-b398-89ec8a5a5505 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1b0627af-2714-4c0c-9694-adeb9c85bc63 req-57531b1b-b5b7-42ea-b398-89ec8a5a5505 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1b0627af-2714-4c0c-9694-adeb9c85bc63 req-57531b1b-b5b7-42ea-b398-89ec8a5a5505 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1b0627af-2714-4c0c-9694-adeb9c85bc63 req-57531b1b-b5b7-42ea-b398-89ec8a5a5505 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-1b0627af-2714-4c0c-9694-adeb9c85bc63 req-57531b1b-b5b7-42ea-b398-89ec8a5a5505 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:43 user nova-compute[74934]: WARNING nova.compute.manager [req-1b0627af-2714-4c0c-9694-adeb9c85bc63 req-57531b1b-b5b7-42ea-b398-89ec8a5a5505 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state building and task_state spawning.
Nov 19 14:52:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:52:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance spawned successfully.
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-82559efe-4876-4225-840c-c32651c7cfd1 req-95b458b5-fa46-4a8b-b8a3-a624697edba3 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-82559efe-4876-4225-840c-c32651c7cfd1 req-95b458b5-fa46-4a8b-b8a3-a624697edba3 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-82559efe-4876-4225-840c-c32651c7cfd1 req-95b458b5-fa46-4a8b-b8a3-a624697edba3 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-82559efe-4876-4225-840c-c32651c7cfd1 req-95b458b5-fa46-4a8b-b8a3-a624697edba3 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-82559efe-4876-4225-840c-c32651c7cfd1 req-95b458b5-fa46-4a8b-b8a3-a624697edba3 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:45 user nova-compute[74934]: WARNING nova.compute.manager [req-82559efe-4876-4225-840c-c32651c7cfd1 req-95b458b5-fa46-4a8b-b8a3-a624697edba3 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state building and task_state spawning.
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:52:45 user nova-compute[74934]: INFO nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 19 14:52:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:52:45 user nova-compute[74934]: INFO nova.compute.manager [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Took 8.14 seconds to build instance.
Nov 19 14:52:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-620a1572-6ab6-4aa8-86aa-7f25322cb199 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.270s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:46 user nova-compute[74934]: INFO nova.compute.manager [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Rescuing
Nov 19 14:52:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:46 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:52:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:47 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance destroyed successfully.
Nov 19 14:52:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Attempting rescue
Nov 19 14:52:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74934) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 14:52:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Creating image(s)
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'trusted_certs' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.317s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue" returned: 0 in 0.074s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'migration_context' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.base [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<ede07940-0d9c-41ce-8d54-8b1d042f4da2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Start _get_guest_xml network_info=[{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:61:d9:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'resources' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.base [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<ede07940-0d9c-41ce-8d54-8b1d042f4da2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'numa_topology' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.base [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<ede07940-0d9c-41ce-8d54-8b1d042f4da2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'vcpu_model' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.base [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<ede07940-0d9c-41ce-8d54-8b1d042f4da2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-359330948',display_name='tempest-ServerRescueNegativeTestJSON-server-359330948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-359330948',id=1,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-3jgjyib6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:48:19Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=ede07940-0d9c-41ce-8d54-8b1d042f4da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:61:d9:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:61:d9:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'pci_devices' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.objects.base [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<ede07940-0d9c-41ce-8d54-8b1d042f4da2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:52:49 user nova-compute[74934]:   <uuid>ede07940-0d9c-41ce-8d54-8b1d042f4da2</uuid>
Nov 19 14:52:49 user nova-compute[74934]:   <name>instance-00000001</name>
Nov 19 14:52:49 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:52:49 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:52:49 user nova-compute[74934]:   <metadata>
Nov 19 14:52:49 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:52:49 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:52:49 user nova-compute[74934]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-359330948</nova:name>
Nov 19 14:52:49 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:52:49</nova:creationTime>
Nov 19 14:52:49 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:52:49 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:52:49 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:52:49 user nova-compute[74934]:       <nova:owner>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:user uuid="cdbd678512a7438bac9bc337a0d94ecf">tempest-ServerRescueNegativeTestJSON-1330458851-project-member</nova:user>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:project uuid="0de5bebd7613411cb782d31ed1884da8">tempest-ServerRescueNegativeTestJSON-1330458851</nova:project>
Nov 19 14:52:49 user nova-compute[74934]:       </nova:owner>
Nov 19 14:52:49 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:52:49 user nova-compute[74934]:       <nova:ports>
Nov 19 14:52:49 user nova-compute[74934]:         <nova:port uuid="2bfefc92-c855-4bd2-bf90-d7e3f7847926">
Nov 19 14:52:49 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:52:49 user nova-compute[74934]:         </nova:port>
Nov 19 14:52:49 user nova-compute[74934]:       </nova:ports>
Nov 19 14:52:49 user nova-compute[74934]:     </nova:instance>
Nov 19 14:52:49 user nova-compute[74934]:   </metadata>
Nov 19 14:52:49 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:52:49 user nova-compute[74934]:     <system>
Nov 19 14:52:49 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:52:49 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:52:49 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:52:49 user nova-compute[74934]:       <entry name="serial">ede07940-0d9c-41ce-8d54-8b1d042f4da2</entry>
Nov 19 14:52:49 user nova-compute[74934]:       <entry name="uuid">ede07940-0d9c-41ce-8d54-8b1d042f4da2</entry>
Nov 19 14:52:49 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:52:49 user nova-compute[74934]:     </system>
Nov 19 14:52:49 user nova-compute[74934]:   </sysinfo>
Nov 19 14:52:49 user nova-compute[74934]:   <os>
Nov 19 14:52:49 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:52:49 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:52:49 user nova-compute[74934]:   </os>
Nov 19 14:52:49 user nova-compute[74934]:   <features>
Nov 19 14:52:49 user nova-compute[74934]:     <acpi/>
Nov 19 14:52:49 user nova-compute[74934]:     <apic/>
Nov 19 14:52:49 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:52:49 user nova-compute[74934]:   </features>
Nov 19 14:52:49 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:52:49 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:52:49 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:52:49 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:52:49 user nova-compute[74934]:   </clock>
Nov 19 14:52:49 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:52:49 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:52:49 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:52:49 user nova-compute[74934]:   </cpu>
Nov 19 14:52:49 user nova-compute[74934]:   <devices>
Nov 19 14:52:49 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:49 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:49 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue"/>
Nov 19 14:52:49 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:52:49 user nova-compute[74934]:     </disk>
Nov 19 14:52:49 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:49 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:49 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk"/>
Nov 19 14:52:49 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:52:49 user nova-compute[74934]:     </disk>
Nov 19 14:52:49 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:52:49 user nova-compute[74934]:       <mac address="fa:16:3e:61:d9:8c"/>
Nov 19 14:52:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:49 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:52:49 user nova-compute[74934]:       <target dev="tap2bfefc92-c8"/>
Nov 19 14:52:49 user nova-compute[74934]:     </interface>
Nov 19 14:52:49 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:52:49 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/console.log" append="off"/>
Nov 19 14:52:49 user nova-compute[74934]:     </serial>
Nov 19 14:52:49 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:52:49 user nova-compute[74934]:     <video>
Nov 19 14:52:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:49 user nova-compute[74934]:     </video>
Nov 19 14:52:49 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:52:49 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:52:49 user nova-compute[74934]:     </rng>
Nov 19 14:52:49 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:52:49 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:52:49 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:52:49 user nova-compute[74934]:     </memballoon>
Nov 19 14:52:49 user nova-compute[74934]:   </devices>
Nov 19 14:52:49 user nova-compute[74934]: </domain>
Nov 19 14:52:49 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:49 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance destroyed successfully.
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:61:d9:8c, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:52:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:51 user nova-compute[74934]: INFO nova.compute.manager [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Rescuing
Nov 19 14:52:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:52:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:52:51 user nova-compute[74934]: DEBUG nova.network.neutron [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG nova.network.neutron [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating instance_info_cache with network_info: [{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-4d336bdf-6cbf-4273-a0f7-4a1966bd11cb req-1b43341f-da01-446a-9b45-5dbd0ac6636f service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4d336bdf-6cbf-4273-a0f7-4a1966bd11cb req-1b43341f-da01-446a-9b45-5dbd0ac6636f service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4d336bdf-6cbf-4273-a0f7-4a1966bd11cb req-1b43341f-da01-446a-9b45-5dbd0ac6636f service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4d336bdf-6cbf-4273-a0f7-4a1966bd11cb req-1b43341f-da01-446a-9b45-5dbd0ac6636f service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-4d336bdf-6cbf-4273-a0f7-4a1966bd11cb req-1b43341f-da01-446a-9b45-5dbd0ac6636f service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:52 user nova-compute[74934]: WARNING nova.compute.manager [req-4d336bdf-6cbf-4273-a0f7-4a1966bd11cb req-1b43341f-da01-446a-9b45-5dbd0ac6636f service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state active and task_state rescuing.
Nov 19 14:52:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance destroyed successfully.
Nov 19 14:52:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Attempting a stable device rescue
Nov 19 14:52:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74934) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 14:52:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Creating image(s)
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ff789a0c-faf3-4e8c-9056-02289afa74a6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:55 user nova-compute[74934]: WARNING nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:55 user nova-compute[74934]: WARNING nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:55 user nova-compute[74934]: WARNING nova.compute.manager [req-5d7a780e-f602-409d-9aae-0886b5631a22 req-dc63c1b9-d5e6-4bda-8dc3-3a953bb2cb53 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.part --force-share --output=json" returned: 0 in 0.252s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.virt.images [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] 9e2dabf8-a885-4f47-84b3-0a87b37694a2 was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.part /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.365s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.part /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.converted" returned: 0 in 1.683s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:57 user nova-compute[74934]: WARNING nova.compute.manager [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.compute.manager [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:57 user nova-compute[74934]: WARNING nova.compute.manager [req-80fa1d16-27b7-4230-98bf-f44019340bc3 req-e310b5e9-9d23-421c-b530-c2625767cb39 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.746s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e,backing_fmt=raw /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e,backing_fmt=raw /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue" returned: 0 in 0.107s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'migration_context' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<f1546e24-c8ba-40b9-81f9-084ab10c9a31> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Start _get_guest_xml network_info=[{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "vif_mac": "fa:16:3e:99:bf:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9e2dabf8-a885-4f47-84b3-0a87b37694a2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '909af401-c2b2-4045-9806-4050779df4ff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f1546e24-c8ba-40b9-81f9-084ab10c9a31', 'attached_at': '', 'detached_at': '', 'volume_id': '209acf5b-0510-43d2-b195-0e2b368807dc', 'serial': '209acf5b-0510-43d2-b195-0e2b368807dc'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'resources' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<f1546e24-c8ba-40b9-81f9-084ab10c9a31> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'numa_topology' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<f1546e24-c8ba-40b9-81f9-084ab10c9a31> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:57 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:57 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.objects.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<f1546e24-c8ba-40b9-81f9-084ab10c9a31> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:52:57 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:52:57 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:52:57 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json" returned: 0 in 0.285s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32ede9a-8720-4562-80e9-b5588be2bc9b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hOlRnrVQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 19 14:52:57 user nova-compute[74934]: node.name = iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:52:57 user nova-compute[74934]: node.tpgt = -1
Nov 19 14:52:57 user nova-compute[74934]: node.startup = automatic
Nov 19 14:52:57 user nova-compute[74934]: node.leading_login = No
Nov 19 14:52:57 user nova-compute[74934]: iface.iscsi_ifacename = default
Nov 19 14:52:57 user nova-compute[74934]: iface.net_ifacename = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.ipaddress = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.prefix_len = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.hwaddress = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.transport_name = tcp
Nov 19 14:52:57 user nova-compute[74934]: iface.initiatorname = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.vlan_id = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.vlan_priority = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.vlan_state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.iface_num = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.mtu = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.port = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.bootproto = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.subnet_mask = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.gateway = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_alt_client_id_state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_alt_client_id = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_dns = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_learn_iqn = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_req_vendor_id_state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_vendor_id_state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_vendor_id = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.dhcp_slp_da = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.fragmentation = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.gratuitous_arp = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.incoming_forwarding = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.tos_state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.tos = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.ttl = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.delayed_ack = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.tcp_nagle = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.tcp_wsf_state = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.tcp_wsf = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.tcp_timer_scale = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.tcp_timestamp = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.redirect = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.def_task_mgmt_timeout = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.header_digest = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.data_digest = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.immediate_data = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.initial_r2t = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.data_seq_inorder = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.data_pdu_inorder = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.erl = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.max_receive_data_len = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.first_burst_len = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.max_outstanding_r2t = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.max_burst_len = 0
Nov 19 14:52:57 user nova-compute[74934]: iface.chap_auth = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.bidi_chap = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.strict_login_compliance = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.discovery_auth = <empty>
Nov 19 14:52:57 user nova-compute[74934]: iface.discovery_logout = <empty>
Nov 19 14:52:57 user nova-compute[74934]: node.discovery_address = <empty>
Nov 19 14:52:57 user nova-compute[74934]: node.discovery_port = 0
Nov 19 14:52:57 user nova-compute[74934]: node.discovery_type = static
Nov 19 14:52:57 user nova-compute[74934]: node.session.initial_cmdsn = 0
Nov 19 14:52:57 user nova-compute[74934]: node.session.initial_login_retry_max = 8
Nov 19 14:52:57 user nova-compute[74934]: node.session.xmit_thread_priority = -20
Nov 19 14:52:57 user nova-compute[74934]: node.session.cmds_max = 128
Nov 19 14:52:57 user nova-compute[74934]: node.session.queue_depth = 32
Nov 19 14:52:57 user nova-compute[74934]: node.session.nr_sessions = 1
Nov 19 14:52:57 user nova-compute[74934]: node.session.auth.authmethod = CHAP
Nov 19 14:52:57 user nova-compute[74934]: node.session.auth.username = hOlRnrVQ
Nov 19 14:52:57 user nova-compute[74934]: node.session.auth.password = ***
Nov 19 14:52:57 user nova-compute[74934]: node.session.auth.username_in = <empty>
Nov 19 14:52:57 user nova-compute[74934]: node.session.auth.password_in = <empty>
Nov 19 14:52:57 user nova-compute[74934]: node.session.auth.chap_algs = MD5
Nov 19 14:52:57 user nova-compute[74934]: node.session.timeo.replacement_timeout = 120
Nov 19 14:52:57 user nova-compute[74934]: node.session.err_timeo.abort_timeout = 15
Nov 19 14:52:57 user nova-compute[74934]: node.session.err_timeo.lu_reset_timeout = 30
Nov 19 14:52:57 user nova-compute[74934]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 19 14:52:57 user nova-compute[74934]: node.session.err_timeo.host_reset_timeout = 60
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.FastAbort = Yes
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.InitialR2T = No
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.ImmediateData = Yes
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.FirstBurstLength = 262144
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.MaxBurstLength = 16776192
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.DefaultTime2Retain = 0
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.DefaultTime2Wait = 2
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.MaxConnections = 1
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 19 14:52:57 user nova-compute[74934]: node.session.iscsi.ERL = 0
Nov 19 14:52:57 user nova-compute[74934]: node.session.scan = manual
Nov 19 14:52:57 user nova-compute[74934]: node.session.reopen_max = 0
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].address = 172.16.0.220
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].port = 3260
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].startup = manual
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].tcp.window_size = 524288
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].tcp.type_of_service = 0
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].timeo.logout_timeout = 15
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].timeo.login_timeout = 15
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].timeo.auth_timeout = 45
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].timeo.noop_out_interval = 5
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].timeo.noop_out_timeout = 5
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].iscsi.HeaderDigest = None
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].iscsi.DataDigest = None
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].iscsi.IFMarker = No
Nov 19 14:52:57 user nova-compute[74934]: node.conn[0].iscsi.OFMarker = No
Nov 19 14:52:57 user nova-compute[74934]: # END RECORD
Nov 19 14:52:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd60daf7-ee2a-4ddc-97cc-63bf3eddbfde]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaf71e1-5047-46f7-887a-d63bcd393157]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOlRnrVQ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOlRnrVQ" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc4e756-d7fe-4a99-9864-f2e9ea369ddd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOlRnrVQ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.051s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ad775-dd8e-4ff7-956c-64703cb639bf]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6580c9d7-f5ca-48fe-af79-a088c34998c6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:52:57 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:52:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:52:57 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:52:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:52:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8bf438-6f7e-4fcd-ad2f-efab09aecbee]: (4, ('0 0 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.318s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== connect_volume: return (321ms) {'type': 'block', 'scsi_wwn': '26535393261313334', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535393261313334', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1820545125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1820545125',id=14,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:51:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-229itr1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:51:19Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=f1546e24-c8ba-40b9-81f9-084ab10c9a31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "vif_mac": "fa:16:3e:99:bf:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "vif_mac": "fa:16:3e:99:bf:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'pci_devices' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.objects.base [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<f1546e24-c8ba-40b9-81f9-084ab10c9a31> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:52:58 user nova-compute[74934]:   <uuid>f1546e24-c8ba-40b9-81f9-084ab10c9a31</uuid>
Nov 19 14:52:58 user nova-compute[74934]:   <name>instance-0000000e</name>
Nov 19 14:52:58 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:52:58 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:52:58 user nova-compute[74934]:   <metadata>
Nov 19 14:52:58 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:52:58 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:52:58 user nova-compute[74934]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1820545125</nova:name>
Nov 19 14:52:58 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:52:57</nova:creationTime>
Nov 19 14:52:58 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:52:58 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:52:58 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:52:58 user nova-compute[74934]:       <nova:owner>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:user uuid="08d75edb533b4dfca6e9785c439df050">tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member</nova:user>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:project uuid="0da5862e932d40a68f17b4e8bb77ef77">tempest-ServerBootFromVolumeStableRescueTest-1047020547</nova:project>
Nov 19 14:52:58 user nova-compute[74934]:       </nova:owner>
Nov 19 14:52:58 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:52:58 user nova-compute[74934]:       <nova:ports>
Nov 19 14:52:58 user nova-compute[74934]:         <nova:port uuid="d5401bfd-dacc-4573-b48f-16f6cac437e6">
Nov 19 14:52:58 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:52:58 user nova-compute[74934]:         </nova:port>
Nov 19 14:52:58 user nova-compute[74934]:       </nova:ports>
Nov 19 14:52:58 user nova-compute[74934]:     </nova:instance>
Nov 19 14:52:58 user nova-compute[74934]:   </metadata>
Nov 19 14:52:58 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:52:58 user nova-compute[74934]:     <system>
Nov 19 14:52:58 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:52:58 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:52:58 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:52:58 user nova-compute[74934]:       <entry name="serial">f1546e24-c8ba-40b9-81f9-084ab10c9a31</entry>
Nov 19 14:52:58 user nova-compute[74934]:       <entry name="uuid">f1546e24-c8ba-40b9-81f9-084ab10c9a31</entry>
Nov 19 14:52:58 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:52:58 user nova-compute[74934]:     </system>
Nov 19 14:52:58 user nova-compute[74934]:   </sysinfo>
Nov 19 14:52:58 user nova-compute[74934]:   <os>
Nov 19 14:52:58 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:52:58 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:52:58 user nova-compute[74934]:   </os>
Nov 19 14:52:58 user nova-compute[74934]:   <features>
Nov 19 14:52:58 user nova-compute[74934]:     <acpi/>
Nov 19 14:52:58 user nova-compute[74934]:     <apic/>
Nov 19 14:52:58 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:52:58 user nova-compute[74934]:   </features>
Nov 19 14:52:58 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:52:58 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:52:58 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:52:58 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:52:58 user nova-compute[74934]:   </clock>
Nov 19 14:52:58 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:52:58 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:52:58 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:52:58 user nova-compute[74934]:   </cpu>
Nov 19 14:52:58 user nova-compute[74934]:   <devices>
Nov 19 14:52:58 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:52:58 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:52:58 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 14:52:58 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:52:58 user nova-compute[74934]:       <serial>209acf5b-0510-43d2-b195-0e2b368807dc</serial>
Nov 19 14:52:58 user nova-compute[74934]:     </disk>
Nov 19 14:52:58 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:52:58 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:52:58 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue"/>
Nov 19 14:52:58 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:52:58 user nova-compute[74934]:       <boot order="1"/>
Nov 19 14:52:58 user nova-compute[74934]:     </disk>
Nov 19 14:52:58 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:52:58 user nova-compute[74934]:       <mac address="fa:16:3e:99:bf:09"/>
Nov 19 14:52:58 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:58 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:52:58 user nova-compute[74934]:       <target dev="tapd5401bfd-da"/>
Nov 19 14:52:58 user nova-compute[74934]:     </interface>
Nov 19 14:52:58 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:52:58 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/console.log" append="off"/>
Nov 19 14:52:58 user nova-compute[74934]:     </serial>
Nov 19 14:52:58 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:52:58 user nova-compute[74934]:     <video>
Nov 19 14:52:58 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:52:58 user nova-compute[74934]:     </video>
Nov 19 14:52:58 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:52:58 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:52:58 user nova-compute[74934]:     </rng>
Nov 19 14:52:58 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:52:58 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:52:58 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:52:58 user nova-compute[74934]:     </memballoon>
Nov 19 14:52:58 user nova-compute[74934]:   </devices>
Nov 19 14:52:58 user nova-compute[74934]: </domain>
Nov 19 14:52:58 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:52:58 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance destroyed successfully.
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No VIF found with MAC fa:16:3e:99:bf:09, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:59 user nova-compute[74934]: WARNING nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:59 user nova-compute[74934]: WARNING nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state None.
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:59 user nova-compute[74934]: WARNING nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state active and task_state rescuing.
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:52:59 user nova-compute[74934]: WARNING nova.compute.manager [req-66d89e33-b13b-442a-852e-68cedb5d64ae req-0505a7b4-5e8a-44b9-975a-15ecbb30d505 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state active and task_state rescuing.
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:52:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:52:59 user nova-compute[74934]: INFO nova.compute.claims [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Claim successful on node user
Nov 19 14:52:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.134s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:53:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:53:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:02 user nova-compute[74934]: WARNING nova.compute.manager [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state active and task_state rescuing.
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:02 user nova-compute[74934]: WARNING nova.compute.manager [req-d7f68d3c-5906-4bec-a710-61b0720e6e88 req-e3fe8f26-00a1-426f-934b-acf92801649a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state active and task_state rescuing.
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-eb9e4a5c-d478-4c71-ae0f-cc595314bbac tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:53:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7382MB free_disk=25.321243286132812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:53:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Creating image(s)
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 8b33af6a-67df-485c-84d9-ce224f78e67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 454533ea-062a-4638-bd8a-72091c6106cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4f62bc02-37c5-46f6-a965-c39399ddd813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fee595d0-5f2c-4e12-8806-b28e02675c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk 1073741824" returned: 0 in 0.054s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.policy [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eda5707b8cd7412098e9d0b3e4bdc536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd008f473dc744a9bc9f1ebc2f4cb95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Cannot resize image /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Ensure instance console log exists: /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.024s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.018s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:03 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:53:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.522s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:04 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Successfully created port: f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Successfully updated port: f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquired lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-changed-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Refreshing instance network info cache due to event network-changed-f4e5537c-702b-445b-a266-44da04a6747d. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] Acquiring lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Releasing lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance network_info: |[{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] Acquired lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.network.neutron [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Refreshing network info cache for port f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start _get_guest_xml network_info=[{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:53:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:53:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'pci_devices' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:53:06 user nova-compute[74934]:   <uuid>32eaf46a-1013-456e-9c2c-9f8805a53e20</uuid>
Nov 19 14:53:06 user nova-compute[74934]:   <name>instance-00000014</name>
Nov 19 14:53:06 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:53:06 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:53:06 user nova-compute[74934]:   <metadata>
Nov 19 14:53:06 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:53:06 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:53:06 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeTestJSON-server-2078832358</nova:name>
Nov 19 14:53:06 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:53:05</nova:creationTime>
Nov 19 14:53:06 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:53:06 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:53:06 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:53:06 user nova-compute[74934]:       <nova:owner>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:user uuid="eda5707b8cd7412098e9d0b3e4bdc536">tempest-AttachVolumeTestJSON-980904147-project-member</nova:user>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:project uuid="cd008f473dc744a9bc9f1ebc2f4cb95d">tempest-AttachVolumeTestJSON-980904147</nova:project>
Nov 19 14:53:06 user nova-compute[74934]:       </nova:owner>
Nov 19 14:53:06 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:53:06 user nova-compute[74934]:       <nova:ports>
Nov 19 14:53:06 user nova-compute[74934]:         <nova:port uuid="f4e5537c-702b-445b-a266-44da04a6747d">
Nov 19 14:53:06 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 14:53:06 user nova-compute[74934]:         </nova:port>
Nov 19 14:53:06 user nova-compute[74934]:       </nova:ports>
Nov 19 14:53:06 user nova-compute[74934]:     </nova:instance>
Nov 19 14:53:06 user nova-compute[74934]:   </metadata>
Nov 19 14:53:06 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:53:06 user nova-compute[74934]:     <system>
Nov 19 14:53:06 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:53:06 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:53:06 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:53:06 user nova-compute[74934]:       <entry name="serial">32eaf46a-1013-456e-9c2c-9f8805a53e20</entry>
Nov 19 14:53:06 user nova-compute[74934]:       <entry name="uuid">32eaf46a-1013-456e-9c2c-9f8805a53e20</entry>
Nov 19 14:53:06 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:53:06 user nova-compute[74934]:     </system>
Nov 19 14:53:06 user nova-compute[74934]:   </sysinfo>
Nov 19 14:53:06 user nova-compute[74934]:   <os>
Nov 19 14:53:06 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:53:06 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:53:06 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:53:06 user nova-compute[74934]:   </os>
Nov 19 14:53:06 user nova-compute[74934]:   <features>
Nov 19 14:53:06 user nova-compute[74934]:     <acpi/>
Nov 19 14:53:06 user nova-compute[74934]:     <apic/>
Nov 19 14:53:06 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:53:06 user nova-compute[74934]:   </features>
Nov 19 14:53:06 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:53:06 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:53:06 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:53:06 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:53:06 user nova-compute[74934]:   </clock>
Nov 19 14:53:06 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:53:06 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:53:06 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:53:06 user nova-compute[74934]:   </cpu>
Nov 19 14:53:06 user nova-compute[74934]:   <devices>
Nov 19 14:53:06 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:53:06 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:53:06 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk"/>
Nov 19 14:53:06 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:53:06 user nova-compute[74934]:     </disk>
Nov 19 14:53:06 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:53:06 user nova-compute[74934]:       <mac address="fa:16:3e:81:ed:9b"/>
Nov 19 14:53:06 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:06 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:53:06 user nova-compute[74934]:       <target dev="tapf4e5537c-70"/>
Nov 19 14:53:06 user nova-compute[74934]:     </interface>
Nov 19 14:53:06 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:53:06 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/console.log" append="off"/>
Nov 19 14:53:06 user nova-compute[74934]:     </serial>
Nov 19 14:53:06 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:53:06 user nova-compute[74934]:     <video>
Nov 19 14:53:06 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:06 user nova-compute[74934]:     </video>
Nov 19 14:53:06 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:53:06 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:53:06 user nova-compute[74934]:     </rng>
Nov 19 14:53:06 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:53:06 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:53:06 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:53:06 user nova-compute[74934]:     </memballoon>
Nov 19 14:53:06 user nova-compute[74934]:   </devices>
Nov 19 14:53:06 user nova-compute[74934]: </domain>
Nov 19 14:53:06 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG os_vif [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f63473bc-7bae-5ec8-8a25-927e6e4e81e0', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e5537c-70, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4e5537c-70, col_values=(('qos', UUID('f4b4edff-465e-4a14-bd56-a032717ded57')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4e5537c-70, col_values=(('external_ids', {'iface-id': 'f4e5537c-702b-445b-a266-44da04a6747d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ed:9b', 'vm-uuid': '32eaf46a-1013-456e-9c2c-9f8805a53e20'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:06 user nova-compute[74934]: INFO os_vif [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70')
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [{"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-4eb838ad-d995-407b-ab5a-b8dc8df9a60e" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No VIF found with MAC fa:16:3e:81:ed:9b, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.neutron [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updated VIF entry in instance network info cache for port f4e5537c-702b-445b-a266-44da04a6747d. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG nova.network.neutron [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e6269fe9-783a-43f0-b808-d4dfc71bda9e req-72b309d4-ca1c-4425-8258-2295f3c62d1c service nova] Releasing lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:53:07 user nova-compute[74934]: INFO nova.compute.claims [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Claim successful on node user
Nov 19 14:53:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.976s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:53:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-2d57f456-bf36-4060-82e3-fb8702ce63a8 req-906358b3-c579-408f-b347-248ee6e530eb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2d57f456-bf36-4060-82e3-fb8702ce63a8 req-906358b3-c579-408f-b347-248ee6e530eb service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2d57f456-bf36-4060-82e3-fb8702ce63a8 req-906358b3-c579-408f-b347-248ee6e530eb service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2d57f456-bf36-4060-82e3-fb8702ce63a8 req-906358b3-c579-408f-b347-248ee6e530eb service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-2d57f456-bf36-4060-82e3-fb8702ce63a8 req-906358b3-c579-408f-b347-248ee6e530eb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:08 user nova-compute[74934]: WARNING nova.compute.manager [req-2d57f456-bf36-4060-82e3-fb8702ce63a8 req-906358b3-c579-408f-b347-248ee6e530eb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state building and task_state spawning.
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.policy [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63f4c7f018334c358470fe0104e709d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437e3d86ee8742cfba5cfe234a7cca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:08 user nova-compute[74934]: INFO nova.virt.block_device [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Booting with volume 544e5d76-baf5-48d1-ac1c-07147b08ef06 at /dev/vda
Nov 19 14:53:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c6c2b1-bf4c-4573-9dcd-ea1d04df8c71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae721ab6-775c-48c3-b352-abac49be9b90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae11d42-8a54-478b-8369-a7f4a83337c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6963e325-c2d0-45df-90b6-00f26e760d16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:53:08 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:53:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b64eacc-b632-43da-8444-46a91e4a23f5]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:08 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating existing volume attachment record: f51345d8-959a-4c0e-8d1b-5bcf72c1737c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:53:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Successfully created port: cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:53:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Successfully updated port: cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:10 user nova-compute[74934]: WARNING nova.compute.manager [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state building and task_state spawning.
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing instance network info cache due to event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:53:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance spawned successfully.
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance network_info: |[{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:53:10 user nova-compute[74934]: INFO nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Took 8.19 seconds to spawn the instance on the hypervisor.
Nov 19 14:53:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:53:10 user nova-compute[74934]: INFO nova.compute.manager [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Took 11.38 seconds to build instance.
Nov 19 14:53:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a939ab6-01a8-40a2-bef8-795c2e88b54e tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.542s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updated VIF entry in instance network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:53:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f1ab7948-0bd4-4b8a-9359-3b95f4f56af3 req-6ee90a9b-8cc3-4749-b04a-f8e681235c9d service nova] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "454533ea-062a-4638-bd8a-72091c6106cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "454533ea-062a-4638-bd8a-72091c6106cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "454533ea-062a-4638-bd8a-72091c6106cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "454533ea-062a-4638-bd8a-72091c6106cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "454533ea-062a-4638-bd8a-72091c6106cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:15 user nova-compute[74934]: INFO nova.compute.manager [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Terminating instance
Nov 19 14:53:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Instance destroyed successfully.
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.objects.instance [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'resources' on Instance uuid 454533ea-062a-4638-bd8a-72091c6106cb {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1865424697',display_name='tempest-VolumesAdminNegativeTest-server-1865424697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1865424697',id=15,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:51:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3605109f7c2469095a20fe29e980ac3',ramdisk_id='',reservation_id='r-80nzumid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-539978045',owner_user_name='tempest-VolumesAdminNegativeTest-539978045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:51:25Z,user_data=None,user_id='563b7f767dd949cf8813529257cd7001',uuid=454533ea-062a-4638-bd8a-72091c6106cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converting VIF {"id": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "address": "fa:16:3e:61:ac:10", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47eb5d38-c2", "ovs_interfaceid": "47eb5d38-c2b4-44e3-8088-6ee929a64f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG os_vif [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47eb5d38-c2, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=839c2227-7437-469c-bb64-51c864222505) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:16 user nova-compute[74934]: INFO os_vif [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ac:10,bridge_name='br-int',has_traffic_filtering=True,id=47eb5d38-c2b4-44e3-8088-6ee929a64f91,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47eb5d38-c2')
Nov 19 14:53:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Deleting instance files /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb_del
Nov 19 14:53:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Deletion of /opt/stack/data/nova/instances/454533ea-062a-4638-bd8a-72091c6106cb_del complete
Nov 19 14:53:16 user nova-compute[74934]: INFO nova.compute.manager [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 19 14:53:16 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:53:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Creating image(s)
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Ensure instance console log exists: /opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Start _get_guest_xml network_info=[{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'f51345d8-959a-4c0e-8d1b-5bcf72c1737c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f03aa92d-6048-4c69-b275-deed31447a37', 'attached_at': '', 'detached_at': '', 'volume_id': '544e5d76-baf5-48d1-ac1c-07147b08ef06', 'serial': '544e5d76-baf5-48d1-ac1c-07147b08ef06'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:53:16 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:16 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:53:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:17 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:17 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:17 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cff3ba5-2584-4ac9-8598-242df7143202]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:53:17 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e0f6d-ff85-47d2-ab6e-ff333b6155ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06] added
Nov 19 14:53:17 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[14924962-f9d4-4566-8b72-6904c042a0ea]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7103dd3-8e07-469c-8ab4-3a75c46250d1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwJyUMHG {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwJyUMHG" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[344d79c9-4920-44fe-8f0b-39cedf9e4373]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CwJyUMHG'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af6eb3-90c6-4512-a78b-600147de91bd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05be025-7c0b-4d30-99a9-94497d51447f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8745c51-058d-40da-aec8-47092a2d0cf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]
Nov 19 14:53:17 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.
Nov 19 14:53:17 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e636c29-ae14-4cd1-836e-176b56b3d524]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7068390-fb4a-4fe4-acc0-46322e9d08f0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:17 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:17 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:17 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d5c01-3d68-4b66-bea8-17987b71c77c]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-43805a93-54e3-4527-b332-866ca6deb2f3 req-bd2f2c96-b12b-427a-85aa-3d6c5e24dad6 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Received event network-vif-deleted-47eb5d38-c2b4-44e3-8088-6ee929a64f91 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:17 user nova-compute[74934]: INFO nova.compute.manager [req-43805a93-54e3-4527-b332-866ca6deb2f3 req-bd2f2c96-b12b-427a-85aa-3d6c5e24dad6 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Neutron deleted interface 47eb5d38-c2b4-44e3-8088-6ee929a64f91; detaching it from the instance and deleting it from the info cache
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-43805a93-54e3-4527-b332-866ca6deb2f3 req-bd2f2c96-b12b-427a-85aa-3d6c5e24dad6 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:17 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Took 0.61 seconds to deallocate network for instance.
Nov 19 14:53:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-43805a93-54e3-4527-b332-866ca6deb2f3 req-bd2f2c96-b12b-427a-85aa-3d6c5e24dad6 service nova] [instance: 454533ea-062a-4638-bd8a-72091c6106cb] Detach interface failed, port_id=47eb5d38-c2b4-44e3-8088-6ee929a64f91, reason: Instance 454533ea-062a-4638-bd8a-72091c6106cb could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.665s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:18 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Deleted allocations for instance 454533ea-062a-4638-bd8a-72091c6106cb
Nov 19 14:53:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51229f46-6959-48a0-8ec9-06379c1cd5db tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "454533ea-062a-4638-bd8a-72091c6106cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.536s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23034346137393836', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034346137393836', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1484735444',display_name='tempest-TestShelveInstance-server-1484735444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1484735444',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpFNOqUCNfVYd6dqGjV3IRxvVJqjXnkKpqMLcwHjKSGcWD2G2IiPCyXkGWFGmFXl/V6qoPJnZIuDxsE3q5wxqN0i2Hq2Iz6p2cfZVTDFoRT/hKvFziNFeIL0XLmR+9puw==',key_name='tempest-TestShelveInstance-1632405257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='437e3d86ee8742cfba5cfe234a7cca84',ramdisk_id='',reservation_id='r-hyc90zbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1215943411',owner_user_name='tempest-TestShelveInstance-1215943411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:09Z,user_data=None,user_id='63f4c7f018334c358470fe0104e709d1',uuid=f03aa92d-6048-4c69-b275-deed31447a37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converting VIF {"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.objects.instance [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'pci_devices' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:53:18 user nova-compute[74934]:   <uuid>f03aa92d-6048-4c69-b275-deed31447a37</uuid>
Nov 19 14:53:18 user nova-compute[74934]:   <name>instance-00000015</name>
Nov 19 14:53:18 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:53:18 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:53:18 user nova-compute[74934]:   <metadata>
Nov 19 14:53:18 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:53:18 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:53:18 user nova-compute[74934]:       <nova:name>tempest-TestShelveInstance-server-1484735444</nova:name>
Nov 19 14:53:18 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:53:16</nova:creationTime>
Nov 19 14:53:18 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:53:18 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:53:18 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:53:18 user nova-compute[74934]:       <nova:owner>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:user uuid="63f4c7f018334c358470fe0104e709d1">tempest-TestShelveInstance-1215943411-project-member</nova:user>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:project uuid="437e3d86ee8742cfba5cfe234a7cca84">tempest-TestShelveInstance-1215943411</nova:project>
Nov 19 14:53:18 user nova-compute[74934]:       </nova:owner>
Nov 19 14:53:18 user nova-compute[74934]:       <nova:ports>
Nov 19 14:53:18 user nova-compute[74934]:         <nova:port uuid="cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317">
Nov 19 14:53:18 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 14:53:18 user nova-compute[74934]:         </nova:port>
Nov 19 14:53:18 user nova-compute[74934]:       </nova:ports>
Nov 19 14:53:18 user nova-compute[74934]:     </nova:instance>
Nov 19 14:53:18 user nova-compute[74934]:   </metadata>
Nov 19 14:53:18 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:53:18 user nova-compute[74934]:     <system>
Nov 19 14:53:18 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:53:18 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:53:18 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:53:18 user nova-compute[74934]:       <entry name="serial">f03aa92d-6048-4c69-b275-deed31447a37</entry>
Nov 19 14:53:18 user nova-compute[74934]:       <entry name="uuid">f03aa92d-6048-4c69-b275-deed31447a37</entry>
Nov 19 14:53:18 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:53:18 user nova-compute[74934]:     </system>
Nov 19 14:53:18 user nova-compute[74934]:   </sysinfo>
Nov 19 14:53:18 user nova-compute[74934]:   <os>
Nov 19 14:53:18 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:53:18 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:53:18 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:53:18 user nova-compute[74934]:   </os>
Nov 19 14:53:18 user nova-compute[74934]:   <features>
Nov 19 14:53:18 user nova-compute[74934]:     <acpi/>
Nov 19 14:53:18 user nova-compute[74934]:     <apic/>
Nov 19 14:53:18 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:53:18 user nova-compute[74934]:   </features>
Nov 19 14:53:18 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:53:18 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:53:18 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:53:18 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:53:18 user nova-compute[74934]:   </clock>
Nov 19 14:53:18 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:53:18 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:53:18 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:53:18 user nova-compute[74934]:   </cpu>
Nov 19 14:53:18 user nova-compute[74934]:   <devices>
Nov 19 14:53:18 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:53:18 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:53:18 user nova-compute[74934]:       <source dev="/dev/sdd"/>
Nov 19 14:53:18 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:53:18 user nova-compute[74934]:       <serial>544e5d76-baf5-48d1-ac1c-07147b08ef06</serial>
Nov 19 14:53:18 user nova-compute[74934]:     </disk>
Nov 19 14:53:18 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:53:18 user nova-compute[74934]:       <mac address="fa:16:3e:3d:9c:34"/>
Nov 19 14:53:18 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:18 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:53:18 user nova-compute[74934]:       <target dev="tapcea6ddd2-1d"/>
Nov 19 14:53:18 user nova-compute[74934]:     </interface>
Nov 19 14:53:18 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:53:18 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37/console.log" append="off"/>
Nov 19 14:53:18 user nova-compute[74934]:     </serial>
Nov 19 14:53:18 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:53:18 user nova-compute[74934]:     <video>
Nov 19 14:53:18 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:18 user nova-compute[74934]:     </video>
Nov 19 14:53:18 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:53:18 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:53:18 user nova-compute[74934]:     </rng>
Nov 19 14:53:18 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:53:18 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:53:18 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:53:18 user nova-compute[74934]:     </memballoon>
Nov 19 14:53:18 user nova-compute[74934]:   </devices>
Nov 19 14:53:18 user nova-compute[74934]: </domain>
Nov 19 14:53:18 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1484735444',display_name='tempest-TestShelveInstance-server-1484735444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1484735444',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpFNOqUCNfVYd6dqGjV3IRxvVJqjXnkKpqMLcwHjKSGcWD2G2IiPCyXkGWFGmFXl/V6qoPJnZIuDxsE3q5wxqN0i2Hq2Iz6p2cfZVTDFoRT/hKvFziNFeIL0XLmR+9puw==',key_name='tempest-TestShelveInstance-1632405257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='437e3d86ee8742cfba5cfe234a7cca84',ramdisk_id='',reservation_id='r-hyc90zbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1215943411',owner_user_name='tempest-TestShelveInstance-1215943411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:09Z,user_data=None,user_id='63f4c7f018334c358470fe0104e709d1',uuid=f03aa92d-6048-4c69-b275-deed31447a37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converting VIF {"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG os_vif [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c3a3120-fbae-56ee-8082-ef954217e426', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcea6ddd2-1d, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcea6ddd2-1d, col_values=(('qos', UUID('6791102e-9bf5-4f09-83e3-d68540c7fa30')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcea6ddd2-1d, col_values=(('external_ids', {'iface-id': 'cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:9c:34', 'vm-uuid': 'f03aa92d-6048-4c69-b275-deed31447a37'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:18 user nova-compute[74934]: INFO os_vif [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d')
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] No VIF found with MAC fa:16:3e:3d:9c:34, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:53:18 user nova-compute[74934]: INFO nova.compute.claims [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Claim successful on node user
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:53:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.policy [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dcd4276cf8a406c9c4fe6416d1a6542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785ce4d07724430bc04f3b8fa17a17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:53:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Creating image(s)
Nov 19 14:53:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "/opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "/opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Successfully created port: 235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.570s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.227s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk 1073741824" returned: 0 in 0.060s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.252s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Cannot resize image /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Ensure instance console log exists: /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Successfully updated port: 235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquired lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-changed-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Refreshing instance network info cache due to event network-changed-235b6a15-ebbe-4985-b79d-68bfc4d5c402. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] Acquiring lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Updating instance_info_cache with network_info: [{"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Releasing lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Instance network_info: |[{"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] Acquired lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Refreshing network info cache for port 235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Start _get_guest_xml network_info=[{"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:53:21 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:21 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1979906954',display_name='tempest-ServersNegativeTestJSON-server-1979906954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1979906954',id=22,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6785ce4d07724430bc04f3b8fa17a17f',ramdisk_id='',reservation_id='r-v7a0ge9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1797626430',owner_user_name='tempest-ServersNegativeTestJSON-1797626430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:20Z,user_data=None,user_id='0dcd4276cf8a406c9c4fe6416d1a6542',uuid=1d37c184-b5ab-4074-be81-26eab07f26ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converting VIF {"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d37c184-b5ab-4074-be81-26eab07f26ad {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:53:21 user nova-compute[74934]:   <uuid>1d37c184-b5ab-4074-be81-26eab07f26ad</uuid>
Nov 19 14:53:21 user nova-compute[74934]:   <name>instance-00000016</name>
Nov 19 14:53:21 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:53:21 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:53:21 user nova-compute[74934]:   <metadata>
Nov 19 14:53:21 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:53:21 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:53:21 user nova-compute[74934]:       <nova:name>tempest-ServersNegativeTestJSON-server-1979906954</nova:name>
Nov 19 14:53:21 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:53:21</nova:creationTime>
Nov 19 14:53:21 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:53:21 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:53:21 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:53:21 user nova-compute[74934]:       <nova:owner>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:user uuid="0dcd4276cf8a406c9c4fe6416d1a6542">tempest-ServersNegativeTestJSON-1797626430-project-member</nova:user>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:project uuid="6785ce4d07724430bc04f3b8fa17a17f">tempest-ServersNegativeTestJSON-1797626430</nova:project>
Nov 19 14:53:21 user nova-compute[74934]:       </nova:owner>
Nov 19 14:53:21 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:53:21 user nova-compute[74934]:       <nova:ports>
Nov 19 14:53:21 user nova-compute[74934]:         <nova:port uuid="235b6a15-ebbe-4985-b79d-68bfc4d5c402">
Nov 19 14:53:21 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 19 14:53:21 user nova-compute[74934]:         </nova:port>
Nov 19 14:53:21 user nova-compute[74934]:       </nova:ports>
Nov 19 14:53:21 user nova-compute[74934]:     </nova:instance>
Nov 19 14:53:21 user nova-compute[74934]:   </metadata>
Nov 19 14:53:21 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:53:21 user nova-compute[74934]:     <system>
Nov 19 14:53:21 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:53:21 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:53:21 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:53:21 user nova-compute[74934]:       <entry name="serial">1d37c184-b5ab-4074-be81-26eab07f26ad</entry>
Nov 19 14:53:21 user nova-compute[74934]:       <entry name="uuid">1d37c184-b5ab-4074-be81-26eab07f26ad</entry>
Nov 19 14:53:21 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:53:21 user nova-compute[74934]:     </system>
Nov 19 14:53:21 user nova-compute[74934]:   </sysinfo>
Nov 19 14:53:21 user nova-compute[74934]:   <os>
Nov 19 14:53:21 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:53:21 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:53:21 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:53:21 user nova-compute[74934]:   </os>
Nov 19 14:53:21 user nova-compute[74934]:   <features>
Nov 19 14:53:21 user nova-compute[74934]:     <acpi/>
Nov 19 14:53:21 user nova-compute[74934]:     <apic/>
Nov 19 14:53:21 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:53:21 user nova-compute[74934]:   </features>
Nov 19 14:53:21 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:53:21 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:53:21 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:53:21 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:53:21 user nova-compute[74934]:   </clock>
Nov 19 14:53:21 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:53:21 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:53:21 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:53:21 user nova-compute[74934]:   </cpu>
Nov 19 14:53:21 user nova-compute[74934]:   <devices>
Nov 19 14:53:21 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:53:21 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:53:21 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk"/>
Nov 19 14:53:21 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:53:21 user nova-compute[74934]:     </disk>
Nov 19 14:53:21 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:53:21 user nova-compute[74934]:       <mac address="fa:16:3e:dd:81:c1"/>
Nov 19 14:53:21 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:21 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:53:21 user nova-compute[74934]:       <target dev="tap235b6a15-eb"/>
Nov 19 14:53:21 user nova-compute[74934]:     </interface>
Nov 19 14:53:21 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:53:21 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/console.log" append="off"/>
Nov 19 14:53:21 user nova-compute[74934]:     </serial>
Nov 19 14:53:21 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:53:21 user nova-compute[74934]:     <video>
Nov 19 14:53:21 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:21 user nova-compute[74934]:     </video>
Nov 19 14:53:21 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:53:21 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:53:21 user nova-compute[74934]:     </rng>
Nov 19 14:53:21 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:53:21 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:53:21 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:53:21 user nova-compute[74934]:     </memballoon>
Nov 19 14:53:21 user nova-compute[74934]:   </devices>
Nov 19 14:53:21 user nova-compute[74934]: </domain>
Nov 19 14:53:21 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1979906954',display_name='tempest-ServersNegativeTestJSON-server-1979906954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1979906954',id=22,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6785ce4d07724430bc04f3b8fa17a17f',ramdisk_id='',reservation_id='r-v7a0ge9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1797626430',owner_user_name='tempest-ServersNegativeTestJSON-1797626430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:20Z,user_data=None,user_id='0dcd4276cf8a406c9c4fe6416d1a6542',uuid=1d37c184-b5ab-4074-be81-26eab07f26ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converting VIF {"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG os_vif [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61681131-ee86-53ee-94e5-f4e3b89fba6d', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap235b6a15-eb, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap235b6a15-eb, col_values=(('qos', UUID('967ac09c-0583-4752-910a-d61e149d4555')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap235b6a15-eb, col_values=(('external_ids', {'iface-id': '235b6a15-ebbe-4985-b79d-68bfc4d5c402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:81:c1', 'vm-uuid': '1d37c184-b5ab-4074-be81-26eab07f26ad'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:21 user nova-compute[74934]: INFO os_vif [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb')
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] No VIF found with MAC fa:16:3e:dd:81:c1, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.network.neutron [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Updated VIF entry in instance network info cache for port 235b6a15-ebbe-4985-b79d-68bfc4d5c402. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.network.neutron [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Updating instance_info_cache with network_info: [{"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-77437660-2127-4109-8a58-2042236aeeba req-c48217b7-a088-4f94-84bd-2bba8dd36962 service nova] Releasing lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:53:22 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance spawned successfully.
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:22 user nova-compute[74934]: INFO nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 19 14:53:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:53:22 user nova-compute[74934]: INFO nova.compute.manager [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Took 15.24 seconds to build instance.
Nov 19 14:53:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-47577b85-2e55-40d8-88d1-9be0127c5adf tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.370s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:53:23 user nova-compute[74934]: INFO nova.compute.claims [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Claim successful on node user
Nov 19 14:53:23 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a66680c-0681-41eb-ba1e-8cd11c0557f5 req-852c221f-3948-4a36-8927-52b80b66ed33 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a66680c-0681-41eb-ba1e-8cd11c0557f5 req-852c221f-3948-4a36-8927-52b80b66ed33 service nova] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a66680c-0681-41eb-ba1e-8cd11c0557f5 req-852c221f-3948-4a36-8927-52b80b66ed33 service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a66680c-0681-41eb-ba1e-8cd11c0557f5 req-852c221f-3948-4a36-8927-52b80b66ed33 service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:23 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a66680c-0681-41eb-ba1e-8cd11c0557f5 req-852c221f-3948-4a36-8927-52b80b66ed33 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] No waiting events found dispatching network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:23 user nova-compute[74934]: WARNING nova.compute.manager [req-3a66680c-0681-41eb-ba1e-8cd11c0557f5 req-852c221f-3948-4a36-8927-52b80b66ed33 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received unexpected event network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 for instance with vm_state building and task_state spawning.
Nov 19 14:53:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:53:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.policy [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124c5ebfa08e42e49e2e9d244103a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8926ff675c045458069f7b4e1ebc656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:53:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Creating image(s)
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.232s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-ec3e08aa-9b1b-4227-ace8-06d45c772a9e req-3e98dbcc-229f-45de-89ef-2adaca9008a9 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ec3e08aa-9b1b-4227-ace8-06d45c772a9e req-3e98dbcc-229f-45de-89ef-2adaca9008a9 service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ec3e08aa-9b1b-4227-ace8-06d45c772a9e req-3e98dbcc-229f-45de-89ef-2adaca9008a9 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ec3e08aa-9b1b-4227-ace8-06d45c772a9e req-3e98dbcc-229f-45de-89ef-2adaca9008a9 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-ec3e08aa-9b1b-4227-ace8-06d45c772a9e req-3e98dbcc-229f-45de-89ef-2adaca9008a9 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:24 user nova-compute[74934]: WARNING nova.compute.manager [req-ec3e08aa-9b1b-4227-ace8-06d45c772a9e req-3e98dbcc-229f-45de-89ef-2adaca9008a9 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state active and task_state None.
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.217s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Successfully created port: 525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk 1073741824" returned: 0 in 0.053s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Cannot resize image /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Ensure instance console log exists: /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:53:25 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Instance spawned successfully.
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Successfully updated port: 525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquired lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-changed-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Refreshing instance network info cache due to event network-changed-525b6c1f-c7bc-4084-9728-d49cb10e849c. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] Acquiring lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:25 user nova-compute[74934]: INFO nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-27677e1a-4898-4906-8838-9e47e48c4686 req-ce0a0918-6b53-438d-96f6-333d40921047 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-27677e1a-4898-4906-8838-9e47e48c4686 req-ce0a0918-6b53-438d-96f6-333d40921047 service nova] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-27677e1a-4898-4906-8838-9e47e48c4686 req-ce0a0918-6b53-438d-96f6-333d40921047 service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-27677e1a-4898-4906-8838-9e47e48c4686 req-ce0a0918-6b53-438d-96f6-333d40921047 service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-27677e1a-4898-4906-8838-9e47e48c4686 req-ce0a0918-6b53-438d-96f6-333d40921047 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] No waiting events found dispatching network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:25 user nova-compute[74934]: WARNING nova.compute.manager [req-27677e1a-4898-4906-8838-9e47e48c4686 req-ce0a0918-6b53-438d-96f6-333d40921047 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received unexpected event network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 for instance with vm_state building and task_state spawning.
Nov 19 14:53:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:53:25 user nova-compute[74934]: INFO nova.compute.manager [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Took 7.30 seconds to build instance.
Nov 19 14:53:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6f5bee7a-ab24-41c8-8037-9d484eda5cbb tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.424s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updating instance_info_cache with network_info: [{"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Releasing lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Instance network_info: |[{"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] Acquired lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Refreshing network info cache for port 525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Start _get_guest_xml network_info=[{"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:53:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1948935385',display_name='tempest-AttachVolumeNegativeTest-server-1948935385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1948935385',id=23,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKM74Gnie7UMNC42UHzBVlx2WQIEEh3HVH8RusExhd5ylQ51rvgR5+lRHpHINHAE0Z78RCIL4cZ117vfgmgjr/AuyUSM/kRRV5bm7xRBOvvQwF9q7EgnpgP1TWinFdNeA==',key_name='tempest-keypair-797971721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-4abq1iio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=c5babe01-769c-495d-8e4b-de93e49bc012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'pci_devices' on Instance uuid c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:53:26 user nova-compute[74934]:   <uuid>c5babe01-769c-495d-8e4b-de93e49bc012</uuid>
Nov 19 14:53:26 user nova-compute[74934]:   <name>instance-00000017</name>
Nov 19 14:53:26 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:53:26 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:53:26 user nova-compute[74934]:   <metadata>
Nov 19 14:53:26 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:53:26 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:53:26 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1948935385</nova:name>
Nov 19 14:53:26 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:53:26</nova:creationTime>
Nov 19 14:53:26 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:53:26 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:53:26 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:53:26 user nova-compute[74934]:       <nova:owner>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:user uuid="124c5ebfa08e42e49e2e9d244103a1f4">tempest-AttachVolumeNegativeTest-661612303-project-member</nova:user>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:project uuid="a8926ff675c045458069f7b4e1ebc656">tempest-AttachVolumeNegativeTest-661612303</nova:project>
Nov 19 14:53:26 user nova-compute[74934]:       </nova:owner>
Nov 19 14:53:26 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:53:26 user nova-compute[74934]:       <nova:ports>
Nov 19 14:53:26 user nova-compute[74934]:         <nova:port uuid="525b6c1f-c7bc-4084-9728-d49cb10e849c">
Nov 19 14:53:26 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 19 14:53:26 user nova-compute[74934]:         </nova:port>
Nov 19 14:53:26 user nova-compute[74934]:       </nova:ports>
Nov 19 14:53:26 user nova-compute[74934]:     </nova:instance>
Nov 19 14:53:26 user nova-compute[74934]:   </metadata>
Nov 19 14:53:26 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:53:26 user nova-compute[74934]:     <system>
Nov 19 14:53:26 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:53:26 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:53:26 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:53:26 user nova-compute[74934]:       <entry name="serial">c5babe01-769c-495d-8e4b-de93e49bc012</entry>
Nov 19 14:53:26 user nova-compute[74934]:       <entry name="uuid">c5babe01-769c-495d-8e4b-de93e49bc012</entry>
Nov 19 14:53:26 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:53:26 user nova-compute[74934]:     </system>
Nov 19 14:53:26 user nova-compute[74934]:   </sysinfo>
Nov 19 14:53:26 user nova-compute[74934]:   <os>
Nov 19 14:53:26 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:53:26 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:53:26 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:53:26 user nova-compute[74934]:   </os>
Nov 19 14:53:26 user nova-compute[74934]:   <features>
Nov 19 14:53:26 user nova-compute[74934]:     <acpi/>
Nov 19 14:53:26 user nova-compute[74934]:     <apic/>
Nov 19 14:53:26 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:53:26 user nova-compute[74934]:   </features>
Nov 19 14:53:26 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:53:26 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:53:26 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:53:26 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:53:26 user nova-compute[74934]:   </clock>
Nov 19 14:53:26 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:53:26 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:53:26 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:53:26 user nova-compute[74934]:   </cpu>
Nov 19 14:53:26 user nova-compute[74934]:   <devices>
Nov 19 14:53:26 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:53:26 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:53:26 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk"/>
Nov 19 14:53:26 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:53:26 user nova-compute[74934]:     </disk>
Nov 19 14:53:26 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:53:26 user nova-compute[74934]:       <mac address="fa:16:3e:75:60:00"/>
Nov 19 14:53:26 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:26 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:53:26 user nova-compute[74934]:       <target dev="tap525b6c1f-c7"/>
Nov 19 14:53:26 user nova-compute[74934]:     </interface>
Nov 19 14:53:26 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:53:26 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/console.log" append="off"/>
Nov 19 14:53:26 user nova-compute[74934]:     </serial>
Nov 19 14:53:26 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:53:26 user nova-compute[74934]:     <video>
Nov 19 14:53:26 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:26 user nova-compute[74934]:     </video>
Nov 19 14:53:26 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:53:26 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:53:26 user nova-compute[74934]:     </rng>
Nov 19 14:53:26 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:53:26 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:53:26 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:53:26 user nova-compute[74934]:     </memballoon>
Nov 19 14:53:26 user nova-compute[74934]:   </devices>
Nov 19 14:53:26 user nova-compute[74934]: </domain>
Nov 19 14:53:26 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1948935385',display_name='tempest-AttachVolumeNegativeTest-server-1948935385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1948935385',id=23,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKM74Gnie7UMNC42UHzBVlx2WQIEEh3HVH8RusExhd5ylQ51rvgR5+lRHpHINHAE0Z78RCIL4cZ117vfgmgjr/AuyUSM/kRRV5bm7xRBOvvQwF9q7EgnpgP1TWinFdNeA==',key_name='tempest-keypair-797971721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-4abq1iio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=c5babe01-769c-495d-8e4b-de93e49bc012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG os_vif [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '340560c1-4eac-543b-87fe-19abbdf1131f', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525b6c1f-c7, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap525b6c1f-c7, col_values=(('qos', UUID('eeab0eaf-27eb-404a-9c20-80888f434476')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap525b6c1f-c7, col_values=(('external_ids', {'iface-id': '525b6c1f-c7bc-4084-9728-d49cb10e849c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:60:00', 'vm-uuid': 'c5babe01-769c-495d-8e4b-de93e49bc012'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:26 user nova-compute[74934]: INFO os_vif [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7')
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:75:60:00, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updated VIF entry in instance network info cache for port 525b6c1f-c7bc-4084-9728-d49cb10e849c. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updating instance_info_cache with network_info: [{"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-171cf00a-8a52-469d-aca4-f42c2e4f0c09 req-605290b4-c19d-4162-abb9-9caee2c9aad4 service nova] Releasing lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-14261f6d-9b15-4ce2-94ce-9c3f93e0bd8a req-33d3d4fc-c00b-41bf-b027-284189472323 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14261f6d-9b15-4ce2-94ce-9c3f93e0bd8a req-33d3d4fc-c00b-41bf-b027-284189472323 service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14261f6d-9b15-4ce2-94ce-9c3f93e0bd8a req-33d3d4fc-c00b-41bf-b027-284189472323 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-14261f6d-9b15-4ce2-94ce-9c3f93e0bd8a req-33d3d4fc-c00b-41bf-b027-284189472323 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-14261f6d-9b15-4ce2-94ce-9c3f93e0bd8a req-33d3d4fc-c00b-41bf-b027-284189472323 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:26 user nova-compute[74934]: WARNING nova.compute.manager [req-14261f6d-9b15-4ce2-94ce-9c3f93e0bd8a req-33d3d4fc-c00b-41bf-b027-284189472323 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state active and task_state None.
Nov 19 14:53:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-bf1a15c7-4929-438b-8a20-2cd168b5c436 req-5bcaf01b-30b3-4212-9ae0-8a01ab4ea49b service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bf1a15c7-4929-438b-8a20-2cd168b5c436 req-5bcaf01b-30b3-4212-9ae0-8a01ab4ea49b service nova] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bf1a15c7-4929-438b-8a20-2cd168b5c436 req-5bcaf01b-30b3-4212-9ae0-8a01ab4ea49b service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bf1a15c7-4929-438b-8a20-2cd168b5c436 req-5bcaf01b-30b3-4212-9ae0-8a01ab4ea49b service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-bf1a15c7-4929-438b-8a20-2cd168b5c436 req-5bcaf01b-30b3-4212-9ae0-8a01ab4ea49b service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] No waiting events found dispatching network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:27 user nova-compute[74934]: WARNING nova.compute.manager [req-bf1a15c7-4929-438b-8a20-2cd168b5c436 req-5bcaf01b-30b3-4212-9ae0-8a01ab4ea49b service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received unexpected event network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c for instance with vm_state building and task_state spawning.
Nov 19 14:53:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:53:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Instance spawned successfully.
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-85766fa0-41dc-4833-8a79-a13e8f1877b0 req-0dfb851b-3f11-44ca-aad3-0f7b068c74f1 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85766fa0-41dc-4833-8a79-a13e8f1877b0 req-0dfb851b-3f11-44ca-aad3-0f7b068c74f1 service nova] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85766fa0-41dc-4833-8a79-a13e8f1877b0 req-0dfb851b-3f11-44ca-aad3-0f7b068c74f1 service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85766fa0-41dc-4833-8a79-a13e8f1877b0 req-0dfb851b-3f11-44ca-aad3-0f7b068c74f1 service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-85766fa0-41dc-4833-8a79-a13e8f1877b0 req-0dfb851b-3f11-44ca-aad3-0f7b068c74f1 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] No waiting events found dispatching network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:29 user nova-compute[74934]: WARNING nova.compute.manager [req-85766fa0-41dc-4833-8a79-a13e8f1877b0 req-0dfb851b-3f11-44ca-aad3-0f7b068c74f1 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received unexpected event network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c for instance with vm_state building and task_state spawning.
Nov 19 14:53:30 user nova-compute[74934]: INFO nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 19 14:53:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:53:30 user nova-compute[74934]: INFO nova.compute.manager [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Took 6.84 seconds to build instance.
Nov 19 14:53:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d511def1-4d38-4746-a6c8-28c72316d39f tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.960s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-changed-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Refreshing instance network info cache due to event network-changed-d827e47e-9033-4f04-9987-837c6460c55a. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:53:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] Acquiring lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:53:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] Acquired lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:53:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Refreshing network info cache for port d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updated VIF entry in instance network info cache for port d827e47e-9033-4f04-9987-837c6460c55a. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating instance_info_cache with network_info: [{"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7292350b-ca88-4fce-8fca-a3a16485eb5f req-7fb3f27c-ce71-46d6-a8f2-80e1db52c272 service nova] Releasing lock "refresh_cache-4e1f21d2-f784-49d3-b2f4-52f0226c048b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'flavor' on Instance uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:38 user nova-compute[74934]: INFO nova.compute.manager [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attaching volume 9ee7fafa-fc91-4208-b2f7-67f45bcb3717 to /dev/vdb
Nov 19 14:53:38 user nova-compute[74934]: DEBUG os_brick.utils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4770bb-234b-4e1a-8500-3019772f6019]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb55fa-4f53-4cd1-8357-2af553e16f4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad56975c-1c27-4c5f-b19c-f887a923adeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81e2c3e-591b-42af-99a0-407c4226e9a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:53:38 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:53:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c371d36-ad6b-454d-9aba-04ac604449cc]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG os_brick.utils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:38 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating existing volume attachment record: 9e5277e2-c6cd-4d2e-95ff-952f8fd9102f {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:53:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:44 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:44 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:44 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04b972b-1abe-48dd-b3e2-f570eda26dc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:53:44 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d09dbd-705c-4c76-9b57-a7666f6db968]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717] added
Nov 19 14:53:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c77cb-a813-4cc7-bae7-a8cfbc8025b7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a94e47-1ecf-43d5-ab66-2a8040292824]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZFKRwMA {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZFKRwMA" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aaa0a4-31ff-41dc-a6ae-297d70ed90f7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZFKRwMA'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[09517938-cfbc-4ffd-a2d1-4887e62185bf]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77246dc-081b-4a40-9cb9-52e021bc2e19]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd88465-154f-45ad-a9de-029e93ab3f1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]
Nov 19 14:53:44 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.
Nov 19 14:53:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67cd45e-d452-4bb3-acd5-320c14f0b2ff]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6879a-b050-4062-943c-56a35bbdf06c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:53:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:44 user nova-compute[74934]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:53:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[350c9ce2-bec6-4d8f-a0fe-8508f8345988]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:53:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:53:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23264386338386465', 'path': '/dev/sde'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264386338386465', 'path': '/dev/sde'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:53:45 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'flavor' on Instance uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:53:45 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:53:45 user nova-compute[74934]:   <source dev="/dev/sde"/>
Nov 19 14:53:45 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:53:45 user nova-compute[74934]:   <serial>9ee7fafa-fc91-4208-b2f7-67f45bcb3717</serial>
Nov 19 14:53:45 user nova-compute[74934]: </disk>
Nov 19 14:53:45 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No VIF found with MAC fa:16:3e:61:2a:14, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4d6bafaf-43a4-4de8-a990-857608499ce8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.784s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 14:53:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 14:53:47 user nova-compute[74934]: INFO nova.compute.manager [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Rebuilding instance
Nov 19 14:53:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-6ca1704d-3a9c-4380-8561-f1bb2345bdc9 req-e2134f67-4b28-4707-8e2f-fb01ca4b17ff service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-unplugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6ca1704d-3a9c-4380-8561-f1bb2345bdc9 req-e2134f67-4b28-4707-8e2f-fb01ca4b17ff service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6ca1704d-3a9c-4380-8561-f1bb2345bdc9 req-e2134f67-4b28-4707-8e2f-fb01ca4b17ff service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6ca1704d-3a9c-4380-8561-f1bb2345bdc9 req-e2134f67-4b28-4707-8e2f-fb01ca4b17ff service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-6ca1704d-3a9c-4380-8561-f1bb2345bdc9 req-e2134f67-4b28-4707-8e2f-fb01ca4b17ff service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-unplugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:48 user nova-compute[74934]: WARNING nova.compute.manager [req-6ca1704d-3a9c-4380-8561-f1bb2345bdc9 req-e2134f67-4b28-4707-8e2f-fb01ca4b17ff service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-unplugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state active and task_state rebuilding.
Nov 19 14:53:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance destroyed successfully.
Nov 19 14:53:49 user nova-compute[74934]: INFO nova.compute.manager [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Detaching volume 9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:53:49 user nova-compute[74934]: INFO nova.virt.block_device [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attempting to driver detach volume 9ee7fafa-fc91-4208-b2f7-67f45bcb3717 from mountpoint /dev/vdb
Nov 19 14:53:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Attempting to detach device vdb from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:53:49 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:53:49 user nova-compute[74934]:   <source dev="/dev/sde"/>
Nov 19 14:53:49 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:53:49 user nova-compute[74934]:   <serial>9ee7fafa-fc91-4208-b2f7-67f45bcb3717</serial>
Nov 19 14:53:49 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:53:49 user nova-compute[74934]: </disk>
Nov 19 14:53:49 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:53:49 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully detached device vdb from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b from the persistent domain config.
Nov 19 14:53:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5ddde3-8a92-4c4f-91e6-de2f013ae6ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:53:49 user nova-compute[74934]: No targets found.
Nov 19 14:53:49 user nova-compute[74934]: iSNS:
Nov 19 14:53:49 user nova-compute[74934]: No targets found.
Nov 19 14:53:49 user nova-compute[74934]: STATIC:
Nov 19 14:53:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc
Nov 19 14:53:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:53:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:53:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:53:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:49 user nova-compute[74934]: FIRMWARE:
Nov 19 14:53:49 user nova-compute[74934]: No targets found.
Nov 19 14:53:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:53:49 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:53:49 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8127eb-464e-48f9-8512-4ca2dfe0770c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a146ff3d-c98e-41db-8578-858d4436e121]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:49 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:49 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:49 user nova-compute[74934]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:53:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:49 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:49 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:49 user nova-compute[74934]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:53:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4698550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717'): ({'sde'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Removing single pathed devices sde {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7ed8d-2d20-4b0b-9b14-5437ef72ae6e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a512d342-4c11-4a68-bf60-f4a048e334ed]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flushing IO for device /dev/sde {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1ffbc7-cb52-4d76-909f-40fd27db4313]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5f317-0cf6-48ac-a554-65fc22af87d1]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c673241-970e-4460-aa0c-76cc7cb9daae]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c357f63-be9b-4365-b1b5-a0df231f50c7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]
Nov 19 14:53:49 user nova-compute[74934]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.
Nov 19 14:53:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccbc3f3-7fe9-42e9-95e2-9c0a81955c5f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== disconnect_volume: return (315ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:49 user nova-compute[74934]: INFO nova.compute.manager [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Detaching volume 2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc
Nov 19 14:53:49 user nova-compute[74934]: INFO nova.virt.block_device [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Attempting to driver detach volume 2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc from mountpoint /dev/vdc
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Attempting to detach device vdc from instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:53:50 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:53:50 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:53:50 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 14:53:50 user nova-compute[74934]:   <serial>2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc</serial>
Nov 19 14:53:50 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:53:50 user nova-compute[74934]: </disk>
Nov 19 14:53:50 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:53:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully detached device vdc from instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e from the persistent domain config.
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:53:50 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:53:50 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:53:50 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 14:53:50 user nova-compute[74934]:   <serial>2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc</serial>
Nov 19 14:53:50 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:53:50 user nova-compute[74934]: </disk>
Nov 19 14:53:50 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:53:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance destroyed successfully.
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964213297',display_name='tempest-ServerActionsTestOtherA-server-1667384912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964213297',id=16,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BUBDk+mwq/G25w9oNvmbP7s6FB+a/JpUr7aZTk9Pqcry6VoWsygtGANdxOPdDD1+3EVI+ZkoTIkvxM7DRi4n6FFHnmiarrXth1XJhv1EKmLWhiVBJixe4uk06xQaXxQ==',key_name='tempest-keypair-688273119',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-d3000n5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=4e1f21d2-f784-49d3-b2f4-52f0226c048b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd827e47e-90, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d4ce8fc-4590-495a-b8a7-91ade868b988) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb3ebe02-d4bd-41be-8259-b5cb7f9d0ebd req-a9784670-af28-44f9-8039-093c352cad39 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb3ebe02-d4bd-41be-8259-b5cb7f9d0ebd req-a9784670-af28-44f9-8039-093c352cad39 service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb3ebe02-d4bd-41be-8259-b5cb7f9d0ebd req-a9784670-af28-44f9-8039-093c352cad39 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb3ebe02-d4bd-41be-8259-b5cb7f9d0ebd req-a9784670-af28-44f9-8039-093c352cad39 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb3ebe02-d4bd-41be-8259-b5cb7f9d0ebd req-a9784670-af28-44f9-8039-093c352cad39 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:53:50 user nova-compute[74934]: WARNING nova.compute.manager [req-cb3ebe02-d4bd-41be-8259-b5cb7f9d0ebd req-a9784670-af28-44f9-8039-093c352cad39 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state active and task_state rebuilding.
Nov 19 14:53:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:50 user nova-compute[74934]: INFO os_vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90')
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:50 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd0bbbd-cb6c-4c36-99d6-c252246ede25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:53:50 user nova-compute[74934]: No targets found.
Nov 19 14:53:50 user nova-compute[74934]: iSNS:
Nov 19 14:53:50 user nova-compute[74934]: No targets found.
Nov 19 14:53:50 user nova-compute[74934]: STATIC:
Nov 19 14:53:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc
Nov 19 14:53:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:53:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:50 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:53:50 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:53:50 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:53:50 user nova-compute[74934]: FIRMWARE:
Nov 19 14:53:50 user nova-compute[74934]: No targets found.
Nov 19 14:53:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:53:50 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:53:50 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e268fbbe-fbbf-41bd-9484-ecf4e321b15d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8239921-826a-4f81-923a-42fe837a2a21]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:50 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:50 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:50 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:50 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4326560>, {}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Disconnecting from: [] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== disconnect_volume: return (78ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:53:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Deleting instance files /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b_del
Nov 19 14:53:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Deletion of /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b_del complete
Nov 19 14:53:50 user nova-compute[74934]: INFO nova.virt.block_device [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Booting with volume 9ee7fafa-fc91-4208-b2f7-67f45bcb3717 at /dev/vdb
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.utils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8d6cc-5701-4dd3-94fb-eade09d87bb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[739ddb93-41b6-4c42-9215-666c5a35b514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9cb807-b277-473e-8d86-aa3264f551f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2804a0-b25e-453d-a9ae-8a5a29514472]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:53:50 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:53:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05a8bd2-36ac-425b-a6de-4d8de07edf01]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG os_brick.utils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:50 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating existing volume attachment record: 4060f7d3-8311-4fdf-99f9-b5fa53ded974 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:53:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:53:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Creating image(s)
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.166s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk 1073741824" returned: 0 in 0.052s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.165s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Cannot resize image /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Ensure instance console log exists: /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Start _get_guest_xml network_info=[{"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '4060f7d3-8311-4fdf-99f9-b5fa53ded974', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e1f21d2-f784-49d3-b2f4-52f0226c048b', 'attached_at': '', 'detached_at': '', 'volume_id': '9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'serial': '9ee7fafa-fc91-4208-b2f7-67f45bcb3717'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:53:57 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 19 14:53:57 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:53:57 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:57 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:53:57 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de4b63-66a1-4bdf-b483-602be94e9683]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:53:57 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e28dc-67c1-44d8-a7a4-62007d577cea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717] added
Nov 19 14:53:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e11c8-7f77-484a-a31e-717387393962]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3aa0c9-bbaf-44ad-95fc-6151e977ee76]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZFKRwMA {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DZFKRwMA" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad7f9cb-dd54-496d-af5c-6839ff08a69a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DZFKRwMA'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2562985c-bb97-47cb-8163-c2daa2b78122]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70392783-f1a8-44c0-8abe-a7bf0d060881]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3c9c1e-835d-4cdc-9d76-d9cf6869c2d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]
Nov 19 14:53:57 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.
Nov 19 14:53:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d95538-c9eb-413e-acf6-132f9927419a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc9ff0-0376-4eef-9a56-e4d024bca90d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:53:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:53:57 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:53:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c0f995-b015-4cf6-83dd-9108a88e9823]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:53:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6550MB free_disk=25.154178619384766GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23264386338386465', 'path': '/dev/sde'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264386338386465', 'path': '/dev/sde'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964213297',display_name='tempest-ServerActionsTestOtherA-server-1667384912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964213297',id=16,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BUBDk+mwq/G25w9oNvmbP7s6FB+a/JpUr7aZTk9Pqcry6VoWsygtGANdxOPdDD1+3EVI+ZkoTIkvxM7DRi4n6FFHnmiarrXth1XJhv1EKmLWhiVBJixe4uk06xQaXxQ==',key_name='tempest-keypair-688273119',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-d3000n5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=4e1f21d2-f784-49d3-b2f4-52f0226c048b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:53:58 user nova-compute[74934]:   <uuid>4e1f21d2-f784-49d3-b2f4-52f0226c048b</uuid>
Nov 19 14:53:58 user nova-compute[74934]:   <name>instance-00000010</name>
Nov 19 14:53:58 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:53:58 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:53:58 user nova-compute[74934]:   <metadata>
Nov 19 14:53:58 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:53:58 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:53:58 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherA-server-1667384912</nova:name>
Nov 19 14:53:58 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:53:57</nova:creationTime>
Nov 19 14:53:58 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:53:58 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:53:58 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:53:58 user nova-compute[74934]:       <nova:owner>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:user uuid="77319d6b70b24f22b39342f6955a8fef">tempest-ServerActionsTestOtherA-463456576-project-member</nova:user>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:project uuid="bd2d42525428465c90522337ec5a4b82">tempest-ServerActionsTestOtherA-463456576</nova:project>
Nov 19 14:53:58 user nova-compute[74934]:       </nova:owner>
Nov 19 14:53:58 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:53:58 user nova-compute[74934]:       <nova:ports>
Nov 19 14:53:58 user nova-compute[74934]:         <nova:port uuid="d827e47e-9033-4f04-9987-837c6460c55a">
Nov 19 14:53:58 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 14:53:58 user nova-compute[74934]:         </nova:port>
Nov 19 14:53:58 user nova-compute[74934]:       </nova:ports>
Nov 19 14:53:58 user nova-compute[74934]:     </nova:instance>
Nov 19 14:53:58 user nova-compute[74934]:   </metadata>
Nov 19 14:53:58 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:53:58 user nova-compute[74934]:     <system>
Nov 19 14:53:58 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:53:58 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:53:58 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:53:58 user nova-compute[74934]:       <entry name="serial">4e1f21d2-f784-49d3-b2f4-52f0226c048b</entry>
Nov 19 14:53:58 user nova-compute[74934]:       <entry name="uuid">4e1f21d2-f784-49d3-b2f4-52f0226c048b</entry>
Nov 19 14:53:58 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:53:58 user nova-compute[74934]:     </system>
Nov 19 14:53:58 user nova-compute[74934]:   </sysinfo>
Nov 19 14:53:58 user nova-compute[74934]:   <os>
Nov 19 14:53:58 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:53:58 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:53:58 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:53:58 user nova-compute[74934]:   </os>
Nov 19 14:53:58 user nova-compute[74934]:   <features>
Nov 19 14:53:58 user nova-compute[74934]:     <acpi/>
Nov 19 14:53:58 user nova-compute[74934]:     <apic/>
Nov 19 14:53:58 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:53:58 user nova-compute[74934]:   </features>
Nov 19 14:53:58 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:53:58 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:53:58 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:53:58 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:53:58 user nova-compute[74934]:   </clock>
Nov 19 14:53:58 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:53:58 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:53:58 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:53:58 user nova-compute[74934]:   </cpu>
Nov 19 14:53:58 user nova-compute[74934]:   <devices>
Nov 19 14:53:58 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:53:58 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:53:58 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk"/>
Nov 19 14:53:58 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:53:58 user nova-compute[74934]:     </disk>
Nov 19 14:53:58 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:53:58 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:53:58 user nova-compute[74934]:       <source dev="/dev/sde"/>
Nov 19 14:53:58 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:53:58 user nova-compute[74934]:       <serial>9ee7fafa-fc91-4208-b2f7-67f45bcb3717</serial>
Nov 19 14:53:58 user nova-compute[74934]:     </disk>
Nov 19 14:53:58 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:53:58 user nova-compute[74934]:       <mac address="fa:16:3e:61:2a:14"/>
Nov 19 14:53:58 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:58 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:53:58 user nova-compute[74934]:       <target dev="tapd827e47e-90"/>
Nov 19 14:53:58 user nova-compute[74934]:     </interface>
Nov 19 14:53:58 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:53:58 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/console.log" append="off"/>
Nov 19 14:53:58 user nova-compute[74934]:     </serial>
Nov 19 14:53:58 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:53:58 user nova-compute[74934]:     <video>
Nov 19 14:53:58 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:53:58 user nova-compute[74934]:     </video>
Nov 19 14:53:58 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:53:58 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:53:58 user nova-compute[74934]:     </rng>
Nov 19 14:53:58 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:53:58 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:53:58 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:53:58 user nova-compute[74934]:     </memballoon>
Nov 19 14:53:58 user nova-compute[74934]:   </devices>
Nov 19 14:53:58 user nova-compute[74934]: </domain>
Nov 19 14:53:58 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964213297',display_name='tempest-ServerActionsTestOtherA-server-1667384912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964213297',id=16,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BUBDk+mwq/G25w9oNvmbP7s6FB+a/JpUr7aZTk9Pqcry6VoWsygtGANdxOPdDD1+3EVI+ZkoTIkvxM7DRi4n6FFHnmiarrXth1XJhv1EKmLWhiVBJixe4uk06xQaXxQ==',key_name='tempest-keypair-688273119',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-d3000n5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=4e1f21d2-f784-49d3-b2f4-52f0226c048b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG os_vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2888b78-f6f5-5bfe-8537-cac4fbdc1b22', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd827e47e-90, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd827e47e-90, col_values=(('qos', UUID('dbf29585-ca57-49ea-a274-fabd5abfcb46')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd827e47e-90, col_values=(('external_ids', {'iface-id': 'd827e47e-9033-4f04-9987-837c6460c55a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:2a:14', 'vm-uuid': '4e1f21d2-f784-49d3-b2f4-52f0226c048b'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:58 user nova-compute[74934]: INFO os_vif [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90')
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:53:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No VIF found with MAC fa:16:3e:61:2a:14, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 8b33af6a-67df-485c-84d9-ce224f78e67c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4f62bc02-37c5-46f6-a965-c39399ddd813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fee595d0-5f2c-4e12-8806-b28e02675c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f03aa92d-6048-4c69-b275-deed31447a37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c5babe01-769c-495d-8e4b-de93e49bc012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.032s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:53:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lazy-loading 'flavor' on Instance uuid 4f62bc02-37c5-46f6-a965-c39399ddd813 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-a7c4d338-4347-45b2-a3e7-b179e6a44052 req-0d8534a5-91e2-4162-8fb4-9261dad6bece service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a7c4d338-4347-45b2-a3e7-b179e6a44052 req-0d8534a5-91e2-4162-8fb4-9261dad6bece service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a7c4d338-4347-45b2-a3e7-b179e6a44052 req-0d8534a5-91e2-4162-8fb4-9261dad6bece service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a7c4d338-4347-45b2-a3e7-b179e6a44052 req-0d8534a5-91e2-4162-8fb4-9261dad6bece service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-a7c4d338-4347-45b2-a3e7-b179e6a44052 req-0d8534a5-91e2-4162-8fb4-9261dad6bece service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:00 user nova-compute[74934]: WARNING nova.compute.manager [req-a7c4d338-4347-45b2-a3e7-b179e6a44052 req-0d8534a5-91e2-4162-8fb4-9261dad6bece service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state active and task_state rebuild_spawning.
Nov 19 14:54:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:00 user nova-compute[74934]: INFO nova.compute.manager [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Attaching volume 9be962b9-2aab-4956-866d-ae49a711832a to /dev/vdb
Nov 19 14:54:00 user nova-compute[74934]: DEBUG os_brick.utils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc7dd4a-c76d-4506-b04b-6d322f42e85d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f485923-6eec-4d94-9f96-1894b215a7e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad094ae-30ac-42f0-abc3-7b4c94b1504a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8129995-eb78-4a66-b979-6a191e06d230]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:54:00 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d86c8f-f7b8-48a5-b473-aa7b4889b7e4]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG os_brick.utils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Updating existing volume attachment record: 103ca6e6-f2b4-4f40-b056-a69e246cb937 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updating instance_info_cache with network_info: [{"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-8b33af6a-67df-485c-84d9-ce224f78e67c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:54:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance spawned successfully.
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-9c2cc56d-d6bd-4265-97bf-e95b94503769 req-2e3275ad-527d-40f4-8b70-2806c1a5c108 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c2cc56d-d6bd-4265-97bf-e95b94503769 req-2e3275ad-527d-40f4-8b70-2806c1a5c108 service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c2cc56d-d6bd-4265-97bf-e95b94503769 req-2e3275ad-527d-40f4-8b70-2806c1a5c108 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c2cc56d-d6bd-4265-97bf-e95b94503769 req-2e3275ad-527d-40f4-8b70-2806c1a5c108 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-9c2cc56d-d6bd-4265-97bf-e95b94503769 req-2e3275ad-527d-40f4-8b70-2806c1a5c108 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:02 user nova-compute[74934]: WARNING nova.compute.manager [req-9c2cc56d-d6bd-4265-97bf-e95b94503769 req-2e3275ad-527d-40f4-8b70-2806c1a5c108 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state active and task_state rebuild_spawning.
Nov 19 14:54:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74934) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 19 14:54:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9ca688ac-3e37-4142-8faa-346e470a02eb tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 76da41ee-9c9b-4086-863d-7e6d3f3789b4 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid c493f2fb-19fd-4fee-a280-9b0df1a8362c {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 4f62bc02-37c5-46f6-a965-c39399ddd813 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 1d37c184-b5ab-4074-be81-26eab07f26ad {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "f03aa92d-6048-4c69-b275-deed31447a37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:03 user nova-compute[74934]: WARNING oslo_messaging._drivers.amqpdriver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "f03aa92d-6048-4c69-b275-deed31447a37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:05 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'flavor' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:06 user nova-compute[74934]: INFO nova.compute.manager [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Attaching volume 2511dc16-2c88-4638-ba43-e0a3636726fa to /dev/vdb
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.utils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d513f7-c86c-4438-a28b-ba75d51c27cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a487fb8-efd0-4204-b12d-f6b2d131f020]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab2f8d-7b6d-4652-95c7-cbacba5c96e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa72ed33-5d3e-4e9f-a5e5-85c5ae09cf51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:54:06 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8b358f-97af-4583-a0e2-4d0aac9c3fd0]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.utils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating existing volume attachment record: 5f33d7fc-7408-42b0-b493-47e4481814ee {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOgCwxtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:06 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dc5e0b-95c8-4372-9d12-4e27f7095d24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:54:06 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[214a01b1-2430-402a-9d11-e6907dbc1418]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a] added
Nov 19 14:54:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[055fd7ae-4a24-4d9c-97f2-b633afa6c47d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f109ac-47e7-4634-bff5-aa5166e7cdd1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOgCwxtR {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOgCwxtR" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c6632d-7a72-46e6-8c63-6d63d26fa497]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HOgCwxtR'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[10969b5b-c835-4ae7-99be-491fad02254b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[663adb0b-7858-4337-8913-a1a9545a5002]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93d6dcc-21d1-4539-a275-4526b279c030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260]
Nov 19 14:54:07 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260] successful.
Nov 19 14:54:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e3146-290c-4ee7-8de2-931a5e6fbb17]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13aeb40-b41a-4547-bc80-c63c72f527ef]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)
Nov 19 14:54:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:07 user nova-compute[74934]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)
Nov 19 14:54:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f5403-6ad7-4551-8a1e-8339c37d86dd]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:54:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOgCwxtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23262313065623761', 'path': '/dev/sdf'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262313065623761', 'path': '/dev/sdf'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lazy-loading 'flavor' on Instance uuid 4f62bc02-37c5-46f6-a965-c39399ddd813 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:54:08 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:54:08 user nova-compute[74934]:   <source dev="/dev/sdf"/>
Nov 19 14:54:08 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:54:08 user nova-compute[74934]:   <serial>9be962b9-2aab-4956-866d-ae49a711832a</serial>
Nov 19 14:54:08 user nova-compute[74934]: </disk>
Nov 19 14:54:08 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] No VIF found with MAC fa:16:3e:2d:a7:4c, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-15efbd80-26a9-430a-abb1-3131fc7ddeeb tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.368s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.718s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:09 user nova-compute[74934]: INFO nova.compute.manager [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Terminating instance
Nov 19 14:54:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-6fada841-a120-4c8c-80d1-84f1ffde6981 req-57a94074-53b8-4d7d-b05d-f1d8bd0643ae service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-vif-unplugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6fada841-a120-4c8c-80d1-84f1ffde6981 req-57a94074-53b8-4d7d-b05d-f1d8bd0643ae service nova] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6fada841-a120-4c8c-80d1-84f1ffde6981 req-57a94074-53b8-4d7d-b05d-f1d8bd0643ae service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6fada841-a120-4c8c-80d1-84f1ffde6981 req-57a94074-53b8-4d7d-b05d-f1d8bd0643ae service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-6fada841-a120-4c8c-80d1-84f1ffde6981 req-57a94074-53b8-4d7d-b05d-f1d8bd0643ae service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] No waiting events found dispatching network-vif-unplugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-6fada841-a120-4c8c-80d1-84f1ffde6981 req-57a94074-53b8-4d7d-b05d-f1d8bd0643ae service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-vif-unplugged-bcce1af0-d412-4a2f-a585-f293ef3a015b for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:10 user nova-compute[74934]: INFO nova.compute.manager [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Terminating instance
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e is timed out.
Nov 19 14:54:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully detached device vdc from instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e from the live domain config.
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-a101c4cc-a494-460d-91fc-035024d58b9a req-148aad9f-3f32-4d55-88d3-d18152bbf032 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-vif-unplugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a101c4cc-a494-460d-91fc-035024d58b9a req-148aad9f-3f32-4d55-88d3-d18152bbf032 service nova] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a101c4cc-a494-460d-91fc-035024d58b9a req-148aad9f-3f32-4d55-88d3-d18152bbf032 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a101c4cc-a494-460d-91fc-035024d58b9a req-148aad9f-3f32-4d55-88d3-d18152bbf032 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-a101c4cc-a494-460d-91fc-035024d58b9a req-148aad9f-3f32-4d55-88d3-d18152bbf032 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] No waiting events found dispatching network-vif-unplugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-a101c4cc-a494-460d-91fc-035024d58b9a req-148aad9f-3f32-4d55-88d3-d18152bbf032 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-vif-unplugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qunScUzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:10 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[807057c6-7ffd-429b-b95e-18b55f7c6709]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:54:10 user nova-compute[74934]: No targets found.
Nov 19 14:54:10 user nova-compute[74934]: iSNS:
Nov 19 14:54:10 user nova-compute[74934]: No targets found.
Nov 19 14:54:10 user nova-compute[74934]: STATIC:
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: FIRMWARE:
Nov 19 14:54:10 user nova-compute[74934]: No targets found.
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:54:10 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:54:10 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Instance destroyed successfully.
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lazy-loading 'resources' on Instance uuid 4f62bc02-37c5-46f6-a965-c39399ddd813 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2169b-bcbc-4c6f-97fa-09f46b862835]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1659398234',display_name='tempest-DeleteServersTestJSON-server-1659398234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1659398234',id=17,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3c1ab85f9cb45d498a89a0fc604c365',ramdisk_id='',reservation_id='r-5hs8f35l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1374428341',owner_user_name='tempest-DeleteServersTestJSON-1374428341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:52:15Z,user_data=None,user_id='7c51fecd683c4f249231992e80b25bcc',uuid=4f62bc02-37c5-46f6-a965-c39399ddd813,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Converting VIF {"id": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "address": "fa:16:3e:2d:a7:4c", "network": {"id": "ced2b8af-596e-4ed0-9839-4f432a5eac49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1555441691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c1ab85f9cb45d498a89a0fc604c365", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcce1af0-d4", "ovs_interfaceid": "bcce1af0-d412-4a2f-a585-f293ef3a015b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_vif [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcce1af0-d4, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34d9e8-e52a-45be-8e96-99898d9c5420]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e409ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a61e6f64-3a04-4c17-bafa-935477b7fccf) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78a5338-6214-4c57-9ff8-7bab4ec57cf7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: INFO os_vif [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:a7:4c,bridge_name='br-int',has_traffic_filtering=True,id=bcce1af0-d412-4a2f-a585-f293ef3a015b,network=Network(ced2b8af-596e-4ed0-9839-4f432a5eac49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcce1af0-d4')
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOgCwxtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:10 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[796d7b8c-865d-42eb-a06a-76996dc0ea1b]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b2f3f-0272-46ba-b936-01fb6973fc25]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cce7857-e3d5-4ae2-8dd3-0b2b3b2fbbb8]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[17239c77-4241-4217-a854-6c1cec218e2b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[02afcccc-9fc3-40cd-a090-7f83fcfff935]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260]
Nov 19 14:54:10 user nova-compute[74934]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc, portal: 172.16.0.220,3260] successful.
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac6a7cc-c809-4aed-8a5a-d33acba2f4fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f188b-26e5-4ef7-89cd-8fb6ef481264]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] <== disconnect_volume: return (340ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.201s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e969a763-79ea-4dc8-a532-6599dfec54bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:54:10 user nova-compute[74934]: No targets found.
Nov 19 14:54:10 user nova-compute[74934]: iSNS:
Nov 19 14:54:10 user nova-compute[74934]: No targets found.
Nov 19 14:54:10 user nova-compute[74934]: STATIC:
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a
Nov 19 14:54:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:10 user nova-compute[74934]: FIRMWARE:
Nov 19 14:54:10 user nova-compute[74934]: No targets found.
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:54:10 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:54:10 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d156d-9ea3-4d11-a8b8-dda627b78bfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a94758-3f4c-49e0-b921-a27fbf4b47ca]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:10 user nova-compute[74934]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a (non-flash)
Nov 19 14:54:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e409e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a'): ({'sdf'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Removing single pathed devices sdf {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Instance destroyed successfully.
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lazy-loading 'resources' on Instance uuid 8b33af6a-67df-485c-84d9-ce224f78e67c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9b302-e382-4059-9cd2-2d121557aec0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-847658597',display_name='tempest-VolumesAdminNegativeTest-server-847658597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-847658597',id=6,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCayk4vCNpwTRr7ESQxY9t6Hx/UmZH/ltfKGAAhenoOZsW/jsjkwMJkY9luULJrEtqscjRn43brE0Y235s5Hu63Ke3Q5TFGjzmOJ2U/I4Q0N1TlJbjS0yIlIYFrIxfDcg==',key_name='tempest-keypair-1441234184',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3605109f7c2469095a20fe29e980ac3',ramdisk_id='',reservation_id='r-zj1vie55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-539978045',owner_user_name='tempest-VolumesAdminNegativeTest-539978045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='563b7f767dd949cf8813529257cd7001',uuid=8b33af6a-67df-485c-84d9-ce224f78e67c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converting VIF {"id": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "address": "fa:16:3e:97:c7:cb", "network": {"id": "737c6acd-0f74-46f8-86d6-cbc9fe508a8b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1400892636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3605109f7c2469095a20fe29e980ac3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cc72428-c3", "ovs_interfaceid": "4cc72428-c39e-4bb5-8c34-f64c3b294e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_vif [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cc72428-c3, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c317a75-ce63-4f9f-9def-1696dd51c58d) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1eb79a-c8eb-4424-ac7a-dda0448e4b5f]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Flushing IO for device /dev/sdf {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:10 user nova-compute[74934]: INFO os_vif [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:c7:cb,bridge_name='br-int',has_traffic_filtering=True,id=4cc72428-c39e-4bb5-8c34-f64c3b294e95,network=Network(737c6acd-0f74-46f8-86d6-cbc9fe508a8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cc72428-c3')
Nov 19 14:54:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Deleting instance files /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c_del
Nov 19 14:54:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Deletion of /opt/stack/data/nova/instances/8b33af6a-67df-485c-84d9-ce224f78e67c_del complete
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d827e9-993f-4a25-83a2-073904355be8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3eec0c-944d-4eb1-998c-a6e8c7866810]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:54:11 user nova-compute[74934]: INFO nova.compute.manager [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b37d015-d53d-4ec7-827a-f830faa922b5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bcaf3e-d632-4aac-8fc3-a0a59311a7bb]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260]
Nov 19 14:54:11 user nova-compute[74934]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a, portal: 172.16.0.220,3260] successful.
Nov 19 14:54:11 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be962b9-2aab-4956-866d-ae49a711832a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677e787-f801-4791-a186-e75acad7fb01]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] <== disconnect_volume: return (581ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:54:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Deleting instance files /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813_del
Nov 19 14:54:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Deletion of /opt/stack/data/nova/instances/4f62bc02-37c5-46f6-a965-c39399ddd813_del complete
Nov 19 14:54:11 user nova-compute[74934]: INFO nova.compute.manager [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'flavor' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1e63431b-75af-49af-b8b5-6fca411a59cc tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.441s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:11 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Took 0.50 seconds to deallocate network for instance.
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-c693b265-faeb-48df-9283-2fd74a4b7dcd req-920966b9-5df0-4b28-a852-3f9b7caf7a30 service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-vif-deleted-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:11 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Took 0.83 seconds to deallocate network for instance.
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received event network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] Acquiring lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] No waiting events found dispatching network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:12 user nova-compute[74934]: WARNING nova.compute.manager [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Received unexpected event network-vif-plugged-bcce1af0-d412-4a2f-a585-f293ef3a015b for instance with vm_state active and task_state deleting.
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-7adbb55e-7550-4847-8031-986a8255c07b req-c194a259-5b5a-4416-a91c-a80c85f0f27d service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-vif-deleted-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:12 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Deleted allocations for instance 8b33af6a-67df-485c-84d9-ce224f78e67c
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:12 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:12 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:12 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3532a8b-01fd-4e2e-b80d-a4c69a69ba35 req-acd2a91a-7831-4547-8ace-6df7d436f888 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received event network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3532a8b-01fd-4e2e-b80d-a4c69a69ba35 req-acd2a91a-7831-4547-8ace-6df7d436f888 service nova] Acquiring lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3532a8b-01fd-4e2e-b80d-a4c69a69ba35 req-acd2a91a-7831-4547-8ace-6df7d436f888 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c3532a8b-01fd-4e2e-b80d-a4c69a69ba35 req-acd2a91a-7831-4547-8ace-6df7d436f888 service nova] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c3532a8b-01fd-4e2e-b80d-a4c69a69ba35 req-acd2a91a-7831-4547-8ace-6df7d436f888 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] No waiting events found dispatching network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:12 user nova-compute[74934]: WARNING nova.compute.manager [req-c3532a8b-01fd-4e2e-b80d-a4c69a69ba35 req-acd2a91a-7831-4547-8ace-6df7d436f888 service nova] [instance: 8b33af6a-67df-485c-84d9-ce224f78e67c] Received unexpected event network-vif-plugged-4cc72428-c39e-4bb5-8c34-f64c3b294e95 for instance with vm_state deleted and task_state None.
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bd1c63b6-3565-4ee6-b199-1fdd21821589 tempest-VolumesAdminNegativeTest-539978045 tempest-VolumesAdminNegativeTest-539978045-project-member] Lock "8b33af6a-67df-485c-84d9-ce224f78e67c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:12 user nova-compute[74934]: INFO nova.compute.manager [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] [instance: 4f62bc02-37c5-46f6-a965-c39399ddd813] Took 0.76 seconds to detach 1 volumes for instance.
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b6d577-64b6-42b8-a0a2-d30c1e0dd6b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:54:12 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9032e-a767-4856-80d7-27a8157f756b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa] added
Nov 19 14:54:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c746f4-68aa-4869-9d10-75d21e6bbc2f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ce522-88ff-4b8d-b0d8-d7768a68c3c1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECjrNymB {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECjrNymB" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81b3372-1d05-473c-b5e3-bdea5ec10158]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECjrNymB'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec78317-b82c-4afa-b391-73a3a599865d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8162b2-363d-4dff-a12c-fd5fcd6b33ba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc045b01-2b31-4b7b-9b16-3c2ae3bf4dbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]
Nov 19 14:54:12 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.
Nov 19 14:54:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae4e7a3-2c2c-4415-9614-9788823618fd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bf4147-b37f-4028-a552-b506c22322d8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:54:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:12 user nova-compute[74934]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:54:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a04c0c-a5c9-4de0-a137-a8795909b58b]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:54:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:13 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Deleted allocations for instance 4f62bc02-37c5-46f6-a965-c39399ddd813
Nov 19 14:54:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6a501d30-496e-4eb9-ac22-50a7fa5acc12 tempest-DeleteServersTestJSON-1374428341 tempest-DeleteServersTestJSON-1374428341-project-member] Lock "4f62bc02-37c5-46f6-a965-c39399ddd813" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23965323162383065', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965323162383065', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'flavor' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:54:13 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:54:13 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:54:13 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:54:13 user nova-compute[74934]:   <serial>2511dc16-2c88-4638-ba43-e0a3636726fa</serial>
Nov 19 14:54:13 user nova-compute[74934]: </disk>
Nov 19 14:54:13 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:54:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:54:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:54:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No VIF found with MAC fa:16:3e:17:b2:72, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:54:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a73a9356-a134-40de-a6e9-d18308fb97a1 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.319s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-changed-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing instance network info cache due to event network-changed-469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updated VIF entry in instance network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7d4c0bfa-b601-4f48-9be1-45b8f2cf8716 req-cd6c0eb7-e0dd-4bee-8f7b-f23a9ea9ea76 service nova] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-changed-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing instance network info cache due to event network-changed-469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updated VIF entry in instance network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-42081823-c7e8-401d-8bad-6484bd9e88af req-8dfd3685-7077-4dbd-b545-070e48849a4c service nova] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:24 user nova-compute[74934]: INFO nova.compute.manager [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Rebooting instance
Nov 19 14:54:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:24 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-216af824-8786-4cf8-b050-f43787e5fb68 req-b13e28af-8c64-4490-acc4-0cedee9a4eaf service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-216af824-8786-4cf8-b050-f43787e5fb68 req-b13e28af-8c64-4490-acc4-0cedee9a4eaf service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-216af824-8786-4cf8-b050-f43787e5fb68 req-b13e28af-8c64-4490-acc4-0cedee9a4eaf service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-216af824-8786-4cf8-b050-f43787e5fb68 req-b13e28af-8c64-4490-acc4-0cedee9a4eaf service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-216af824-8786-4cf8-b050-f43787e5fb68 req-b13e28af-8c64-4490-acc4-0cedee9a4eaf service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:25 user nova-compute[74934]: WARNING nova.compute.manager [req-216af824-8786-4cf8-b050-f43787e5fb68 req-b13e28af-8c64-4490-acc4-0cedee9a4eaf service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance destroyed successfully.
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'resources' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020451631',display_name='tempest-TestMinimumBasicScenario-server-2020451631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020451631',id=18,image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPtF8JoIZC0ogO5nssLwdJYOBPPqpTDNBB0Ox0buLQsOyh7QyME+jgiWq2dcAo/ewyMXh6xaxZnybVWDGcALXuhXW5WyuIBR+XV3tM3QHLbjsRDoRrDLz3ZgXVSb4Oa9w==',key_name='tempest-TestMinimumBasicScenario-489823040',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-5ps226ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:54:25Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=fee595d0-5f2c-4e12-8806-b28e02675c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469efd39-a7, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d98ad115-b75a-4cfd-98cd-d6d02e6899e6) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: INFO os_vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7')
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf364fb-c08e-4bae-aff9-dec5b0face09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:54:26 user nova-compute[74934]: No targets found.
Nov 19 14:54:26 user nova-compute[74934]: iSNS:
Nov 19 14:54:26 user nova-compute[74934]: No targets found.
Nov 19 14:54:26 user nova-compute[74934]: STATIC:
Nov 19 14:54:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:54:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:54:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:54:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa
Nov 19 14:54:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:54:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:54:26 user nova-compute[74934]: FIRMWARE:
Nov 19 14:54:26 user nova-compute[74934]: No targets found.
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:54:26 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:54:26 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c83d517-da55-4a18-9c8a-103ee779af26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67a9a62-eff8-4571-ada6-c4c602193d3f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c44c3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeb1b56-eb46-411a-8e54-9ef9254b696a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eef7a7-90f4-42ad-8c8d-98696e57f5d8]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f220778a-f55a-4e45-a57f-542c3a9ae994]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[060edf3f-6394-48b5-a44d-6cd7cfbdb28b]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402c3d4-3f9f-40bd-a9fe-6af92b647251]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d799e3ca-6716-4493-818d-76f9f744c1c0]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]
Nov 19 14:54:26 user nova-compute[74934]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f240786-f3ec-4cb8-b1ec-4e1bf7bdd54f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== disconnect_volume: return (343ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Start _get_guest_xml network_info=[{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9959537f-405f-458f-ba5a-6f1f5e948203,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '9959537f-405f-458f-ba5a-6f1f5e948203'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '5f33d7fc-7408-42b0-b493-47e4481814ee', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fee595d0-5f2c-4e12-8806-b28e02675c74', 'attached_at': '', 'detached_at': '', 'volume_id': '2511dc16-2c88-4638-ba43-e0a3636726fa', 'serial': '2511dc16-2c88-4638-ba43-e0a3636726fa'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:54:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:54:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9959537f-405f-458f-ba5a-6f1f5e948203,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'vcpu_model' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.objects.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Object Instance<fee595d0-5f2c-4e12-8806-b28e02675c74> lazy-loaded attributes: resources,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:54:26 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac868ec-b410-45e8-92db-9641f88a2308]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:54:26 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[868dbbf5-1b85-43c5-b420-81e753b98190]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa] added
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a417cf2-217e-42c4-aa6e-c179ce865343]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb9fcf6-6be1-4f28-a4e0-fbd29d2b8fc1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECjrNymB {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECjrNymB" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd41b23-ec91-4d77-9f21-1357e8366a7e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECjrNymB'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c0d5a6-0e9a-43ed-9702-3b3f0bbf787f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3f19f0-89a4-4046-8ae8-5850e5eb9b1d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101a9bc-af61-4644-8311-a80fec65f0a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]
Nov 19 14:54:26 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84291be-9c53-4d3f-b2b2-82e869eb4740]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a3aaaf-33a5-479e-9967-2e949353f701]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:54:26 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:54:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a243c52-09f6-49a2-9d6a-faabf47534dd]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:27 user nova-compute[74934]: WARNING nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:27 user nova-compute[74934]: WARNING nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:27 user nova-compute[74934]: WARNING nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:27 user nova-compute[74934]: WARNING nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:27 user nova-compute[74934]: WARNING nova.compute.manager [req-88948fdc-1728-4eba-84e4-115b384aa62a req-251cdc06-e267-418a-9498-53f45acd7557 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23965323162383065', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965323162383065', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020451631',display_name='tempest-TestMinimumBasicScenario-server-2020451631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020451631',id=18,image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPtF8JoIZC0ogO5nssLwdJYOBPPqpTDNBB0Ox0buLQsOyh7QyME+jgiWq2dcAo/ewyMXh6xaxZnybVWDGcALXuhXW5WyuIBR+XV3tM3QHLbjsRDoRrDLz3ZgXVSb4Oa9w==',key_name='tempest-TestMinimumBasicScenario-489823040',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-5ps226ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:54:25Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=fee595d0-5f2c-4e12-8806-b28e02675c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'pci_devices' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.objects.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Object Instance<fee595d0-5f2c-4e12-8806-b28e02675c74> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:54:27 user nova-compute[74934]:   <uuid>fee595d0-5f2c-4e12-8806-b28e02675c74</uuid>
Nov 19 14:54:27 user nova-compute[74934]:   <name>instance-00000012</name>
Nov 19 14:54:27 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:54:27 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:54:27 user nova-compute[74934]:   <metadata>
Nov 19 14:54:27 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:54:27 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:54:27 user nova-compute[74934]:       <nova:name>tempest-TestMinimumBasicScenario-server-2020451631</nova:name>
Nov 19 14:54:27 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:54:26</nova:creationTime>
Nov 19 14:54:27 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:54:27 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:54:27 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:54:27 user nova-compute[74934]:       <nova:owner>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:user uuid="6c76ed73a0da4b2f8b6cf6022eb357d6">tempest-TestMinimumBasicScenario-2055579736-project-member</nova:user>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:project uuid="11f5e39f366f4f78aa258740eb0f0fae">tempest-TestMinimumBasicScenario-2055579736</nova:project>
Nov 19 14:54:27 user nova-compute[74934]:       </nova:owner>
Nov 19 14:54:27 user nova-compute[74934]:       <nova:root type="image" uuid="9959537f-405f-458f-ba5a-6f1f5e948203"/>
Nov 19 14:54:27 user nova-compute[74934]:       <nova:ports>
Nov 19 14:54:27 user nova-compute[74934]:         <nova:port uuid="469efd39-a7d3-4ba1-a81e-105842842227">
Nov 19 14:54:27 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 19 14:54:27 user nova-compute[74934]:         </nova:port>
Nov 19 14:54:27 user nova-compute[74934]:       </nova:ports>
Nov 19 14:54:27 user nova-compute[74934]:     </nova:instance>
Nov 19 14:54:27 user nova-compute[74934]:   </metadata>
Nov 19 14:54:27 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:54:27 user nova-compute[74934]:     <system>
Nov 19 14:54:27 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:54:27 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:54:27 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:54:27 user nova-compute[74934]:       <entry name="serial">fee595d0-5f2c-4e12-8806-b28e02675c74</entry>
Nov 19 14:54:27 user nova-compute[74934]:       <entry name="uuid">fee595d0-5f2c-4e12-8806-b28e02675c74</entry>
Nov 19 14:54:27 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:54:27 user nova-compute[74934]:     </system>
Nov 19 14:54:27 user nova-compute[74934]:   </sysinfo>
Nov 19 14:54:27 user nova-compute[74934]:   <os>
Nov 19 14:54:27 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:54:27 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:54:27 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:54:27 user nova-compute[74934]:   </os>
Nov 19 14:54:27 user nova-compute[74934]:   <features>
Nov 19 14:54:27 user nova-compute[74934]:     <acpi/>
Nov 19 14:54:27 user nova-compute[74934]:     <apic/>
Nov 19 14:54:27 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:54:27 user nova-compute[74934]:   </features>
Nov 19 14:54:27 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:54:27 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:54:27 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:54:27 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:54:27 user nova-compute[74934]:   </clock>
Nov 19 14:54:27 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:54:27 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:54:27 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:54:27 user nova-compute[74934]:   </cpu>
Nov 19 14:54:27 user nova-compute[74934]:   <devices>
Nov 19 14:54:27 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:54:27 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:54:27 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk"/>
Nov 19 14:54:27 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:54:27 user nova-compute[74934]:     </disk>
Nov 19 14:54:27 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:54:27 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:54:27 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 14:54:27 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:54:27 user nova-compute[74934]:       <serial>2511dc16-2c88-4638-ba43-e0a3636726fa</serial>
Nov 19 14:54:27 user nova-compute[74934]:     </disk>
Nov 19 14:54:27 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:54:27 user nova-compute[74934]:       <mac address="fa:16:3e:17:b2:72"/>
Nov 19 14:54:27 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:54:27 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:54:27 user nova-compute[74934]:       <target dev="tap469efd39-a7"/>
Nov 19 14:54:27 user nova-compute[74934]:     </interface>
Nov 19 14:54:27 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:54:27 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/console.log" append="off"/>
Nov 19 14:54:27 user nova-compute[74934]:     </serial>
Nov 19 14:54:27 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:54:27 user nova-compute[74934]:     <video>
Nov 19 14:54:27 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:54:27 user nova-compute[74934]:     </video>
Nov 19 14:54:27 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:54:27 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:54:27 user nova-compute[74934]:     </rng>
Nov 19 14:54:27 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:54:27 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:54:27 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:54:27 user nova-compute[74934]:     </memballoon>
Nov 19 14:54:27 user nova-compute[74934]:   </devices>
Nov 19 14:54:27 user nova-compute[74934]: </domain>
Nov 19 14:54:27 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:54:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'trusted_certs' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.objects.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Object Instance<fee595d0-5f2c-4e12-8806-b28e02675c74> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Cannot resize image /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'migration_context' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.objects.base [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Object Instance<fee595d0-5f2c-4e12-8806-b28e02675c74> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020451631',display_name='tempest-TestMinimumBasicScenario-server-2020451631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020451631',id=18,image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPtF8JoIZC0ogO5nssLwdJYOBPPqpTDNBB0Ox0buLQsOyh7QyME+jgiWq2dcAo/ewyMXh6xaxZnybVWDGcALXuhXW5WyuIBR+XV3tM3QHLbjsRDoRrDLz3ZgXVSb4Oa9w==',key_name='tempest-TestMinimumBasicScenario-489823040',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-5ps226ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:54:25Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=fee595d0-5f2c-4e12-8806-b28e02675c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG os_vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fe3cc0a-bda0-5979-81c7-a51061a0fc77', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469efd39-a7, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap469efd39-a7, col_values=(('qos', UUID('eda57322-c9dd-4f29-b66e-9b156a89f3b2')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap469efd39-a7, col_values=(('external_ids', {'iface-id': '469efd39-a7d3-4ba1-a81e-105842842227', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:b2:72', 'vm-uuid': 'fee595d0-5f2c-4e12-8806-b28e02675c74'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:54:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:28 user nova-compute[74934]: INFO os_vif [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7')
Nov 19 14:54:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:29 user nova-compute[74934]: INFO nova.compute.manager [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] instance snapshotting
Nov 19 14:54:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Beginning live snapshot process
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing instance network info cache due to event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG nova.network.neutron [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_wj82nkx/80d6d4cd93a24a19bd32381b063b557d.delta 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_wj82nkx/80d6d4cd93a24a19bd32381b063b557d.delta 1073741824" returned: 0 in 0.047s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 19 14:54:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG nova.network.neutron [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updated VIF entry in instance network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG nova.network.neutron [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c0b07ac0-f0c1-4d0e-bff9-6ad49c065d6c req-49d7caaa-d64c-47fe-b27d-e8f3fc18c4ce service nova] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:54:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 19 14:54:31 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_wj82nkx/80d6d4cd93a24a19bd32381b063b557d.delta /opt/stack/data/nova/instances/snapshots/tmp_wj82nkx/80d6d4cd93a24a19bd32381b063b557d {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:31 user nova-compute[74934]: WARNING nova.compute.manager [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:31 user nova-compute[74934]: WARNING nova.compute.manager [req-565a555b-586b-4f32-ad1c-0df4526c0064 req-57b4ff14-c2a9-4f14-a16f-bcd561f621a7 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state active and task_state reboot_started_hard.
Nov 19 14:54:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_wj82nkx/80d6d4cd93a24a19bd32381b063b557d.delta /opt/stack/data/nova/instances/snapshots/tmp_wj82nkx/80d6d4cd93a24a19bd32381b063b557d" returned: 0 in 0.305s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Snapshot extracted, beginning image upload
Nov 19 14:54:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:54:32 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance rebooted successfully.
Nov 19 14:54:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dea30eb8-b73d-4664-a832-1e11b3bc0cab tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.451s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Snapshot image upload complete
Nov 19 14:54:34 user nova-compute[74934]: INFO nova.compute.manager [None req-03f1dbfc-0db4-4616-bcb1-f25898770393 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Took 4.97 seconds to snapshot the instance on the hypervisor.
Nov 19 14:54:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:38 user nova-compute[74934]: INFO nova.compute.manager [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Unrescuing
Nov 19 14:54:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG nova.objects.instance [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'flavor' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-88e56f3c-8c2a-4757-b2ad-e0398bf706b5 req-2b19a366-94d4-47d4-9d69-723c4973dfee service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88e56f3c-8c2a-4757-b2ad-e0398bf706b5 req-2b19a366-94d4-47d4-9d69-723c4973dfee service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88e56f3c-8c2a-4757-b2ad-e0398bf706b5 req-2b19a366-94d4-47d4-9d69-723c4973dfee service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-88e56f3c-8c2a-4757-b2ad-e0398bf706b5 req-2b19a366-94d4-47d4-9d69-723c4973dfee service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-88e56f3c-8c2a-4757-b2ad-e0398bf706b5 req-2b19a366-94d4-47d4-9d69-723c4973dfee service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:39 user nova-compute[74934]: WARNING nova.compute.manager [req-88e56f3c-8c2a-4757-b2ad-e0398bf706b5 req-2b19a366-94d4-47d4-9d69-723c4973dfee service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance destroyed successfully.
Nov 19 14:54:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:40 user nova-compute[74934]: INFO nova.compute.manager [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Terminating instance
Nov 19 14:54:40 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-919144ee-fb27-4883-81cd-9164a4b529cd req-380379a3-29c9-4e22-8243-6acfd195f403 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-919144ee-fb27-4883-81cd-9164a4b529cd req-380379a3-29c9-4e22-8243-6acfd195f403 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-919144ee-fb27-4883-81cd-9164a4b529cd req-380379a3-29c9-4e22-8243-6acfd195f403 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-919144ee-fb27-4883-81cd-9164a4b529cd req-380379a3-29c9-4e22-8243-6acfd195f403 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-919144ee-fb27-4883-81cd-9164a4b529cd req-380379a3-29c9-4e22-8243-6acfd195f403 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-919144ee-fb27-4883-81cd-9164a4b529cd req-380379a3-29c9-4e22-8243-6acfd195f403 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-474b98ad-79ff-4e0d-8337-d061551b7edd req-426c711b-78ea-4780-baea-0517a9c04e57 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-474b98ad-79ff-4e0d-8337-d061551b7edd req-426c711b-78ea-4780-baea-0517a9c04e57 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-474b98ad-79ff-4e0d-8337-d061551b7edd req-426c711b-78ea-4780-baea-0517a9c04e57 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-474b98ad-79ff-4e0d-8337-d061551b7edd req-426c711b-78ea-4780-baea-0517a9c04e57 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-474b98ad-79ff-4e0d-8337-d061551b7edd req-426c711b-78ea-4780-baea-0517a9c04e57 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:41 user nova-compute[74934]: WARNING nova.compute.manager [req-474b98ad-79ff-4e0d-8337-d061551b7edd req-426c711b-78ea-4780-baea-0517a9c04e57 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Instance destroyed successfully.
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'resources' on Instance uuid 4eb838ad-d995-407b-ab5a-b8dc8df9a60e {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:48:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-825075697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-825075697',id=5,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Y3h6aLjtCzoN+E+lUu1qIcE4QgeNEU2ikSyYhYWuvHg1BlmCQoBaFq86cdChZJUHwzciS4tr2s3Iu1W4lv2rIx8WLnP+FzMdefFfivNjQZMFhpRRsM0GJW1zVwz3eqg==',key_name='tempest-keypair-1600849378',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-qq0f56qz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=4eb838ad-d995-407b-ab5a-b8dc8df9a60e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "address": "fa:16:3e:a8:0b:6b", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cd621cf-48", "ovs_interfaceid": "0cd621cf-48bb-4332-9f77-72fd63bf014b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG os_vif [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cd621cf-48, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc62fc31-2559-4f1c-a9a6-f4d442500c57) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:54:41 user nova-compute[74934]: INFO os_vif [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=0cd621cf-48bb-4332-9f77-72fd63bf014b,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cd621cf-48')
Nov 19 14:54:41 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Deleting instance files /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e_del
Nov 19 14:54:41 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Deletion of /opt/stack/data/nova/instances/4eb838ad-d995-407b-ab5a-b8dc8df9a60e_del complete
Nov 19 14:54:41 user nova-compute[74934]: INFO nova.compute.manager [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 19 14:54:41 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:42 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Took 0.72 seconds to deallocate network for instance.
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-6e613afa-b3a3-47b1-9920-2c0fa15e3323 req-ed5a9b52-3565-4917-84f4-3ed8f17037fe service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-deleted-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:42 user nova-compute[74934]: INFO nova.compute.manager [req-6e613afa-b3a3-47b1-9920-2c0fa15e3323 req-ed5a9b52-3565-4917-84f4-3ed8f17037fe service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Neutron deleted interface 0cd621cf-48bb-4332-9f77-72fd63bf014b; detaching it from the instance and deleting it from the info cache
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.network.neutron [req-6e613afa-b3a3-47b1-9920-2c0fa15e3323 req-ed5a9b52-3565-4917-84f4-3ed8f17037fe service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-6e613afa-b3a3-47b1-9920-2c0fa15e3323 req-ed5a9b52-3565-4917-84f4-3ed8f17037fe service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Detach interface failed, port_id=0cd621cf-48bb-4332-9f77-72fd63bf014b, reason: Instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:42 user nova-compute[74934]: WARNING nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state deleted and task_state None.
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:42 user nova-compute[74934]: WARNING nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state deleted and task_state None.
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:42 user nova-compute[74934]: WARNING nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state deleted and task_state None.
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:42 user nova-compute[74934]: WARNING nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-unplugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state deleted and task_state None.
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Acquiring lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] No waiting events found dispatching network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:42 user nova-compute[74934]: WARNING nova.compute.manager [req-f756c8dd-2071-459b-b233-cab441ec2bb5 req-b672b9cb-0d02-484b-805f-3bc92393cfe4 service nova] [instance: 4eb838ad-d995-407b-ab5a-b8dc8df9a60e] Received unexpected event network-vif-plugged-0cd621cf-48bb-4332-9f77-72fd63bf014b for instance with vm_state deleted and task_state None.
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:42 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Deleted allocations for instance 4eb838ad-d995-407b-ab5a-b8dc8df9a60e
Nov 19 14:54:42 user nova-compute[74934]: INFO nova.compute.manager [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Unrescuing
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG nova.network.neutron [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:54:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4c93c301-2f8c-4205-bf64-f2e218560fd3 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "4eb838ad-d995-407b-ab5a-b8dc8df9a60e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:43 user nova-compute[74934]: WARNING nova.compute.manager [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:43 user nova-compute[74934]: WARNING nova.compute.manager [req-1a1a51dd-3e66-4c58-887c-a80041a81cc8 req-2484b37e-ce0d-45a9-b4a7-14b586399719 service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.network.neutron [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating instance_info_cache with network_info: [{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.objects.instance [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'flavor' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG nova.compute.manager [None req-866ca4ec-7a8b-4da2-a1ac-41c6de04aaae tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance destroyed successfully.
Nov 19 14:54:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:45 user nova-compute[74934]: WARNING nova.compute.manager [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:45 user nova-compute[74934]: WARNING nova.compute.manager [req-533f8af5-2795-43d1-b180-31f186486db4 req-be2ffe82-6c3e-45ec-a012-187712924b96 service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:47 user nova-compute[74934]: WARNING nova.compute.manager [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:47 user nova-compute[74934]: WARNING nova.compute.manager [req-a70855b3-0711-4e39-9e93-144148fe2882 req-5456ea79-ef11-4dde-9331-e83d1e46fa1a service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:54:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-fd663241-01b4-43cf-85cb-3250807e8f8a tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-changed-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Refreshing instance network info cache due to event network-changed-f4e5537c-702b-445b-a266-44da04a6747d. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:54:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] Acquiring lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] Acquired lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Refreshing network info cache for port f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:54:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updated VIF entry in instance network info cache for port f4e5537c-702b-445b-a266-44da04a6747d. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:54:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bbc8b13f-acc3-4641-8a3a-6044e3167686 req-d1eb55e2-3b29-4577-8fb8-cad2fb91bbeb service nova] Releasing lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:54 user nova-compute[74934]: INFO nova.compute.manager [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Attaching volume ed26e3c0-5aab-4ea1-aa51-ad9e9475074b to /dev/vdb
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG os_brick.utils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e2ab98-b67c-45de-b2a6-23ea4b514ef7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb671d1a-7826-4023-aae7-15bf3c06aa45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a61fa80-ec3a-4f60-a708-7882766e81be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[728d1c94-e439-40c4-9cab-6adbe8d194ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:54:54 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd799cac-2713-4fb7-a94f-f446b114cded]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG os_brick.utils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating existing volume attachment record: aaeb49f6-7821-402c-9b9a-58fd790c6201 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:54:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:54:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:54:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:54:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7039MB free_disk=25.13208770751953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fee595d0-5f2c-4e12-8806-b28e02675c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f03aa92d-6048-4c69-b275-deed31447a37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c5babe01-769c-495d-8e4b-de93e49bc012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing instance network info cache due to event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:58 user nova-compute[74934]: DEBUG nova.network.neutron [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updated VIF entry in instance network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49e0e483-9d1b-4572-90c8-a4ca21519f09 req-6ae23a19-d86a-4fa6-8be2-177432a71164 service nova] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:59 user nova-compute[74934]: INFO nova.compute.manager [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Shelve offloading
Nov 19 14:54:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-4044d070-c870-4edd-a859-734d31902fc4 req-6cd26981-239f-4922-b9fc-1ccc494a1f51 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-unplugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4044d070-c870-4edd-a859-734d31902fc4 req-6cd26981-239f-4922-b9fc-1ccc494a1f51 service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4044d070-c870-4edd-a859-734d31902fc4 req-6cd26981-239f-4922-b9fc-1ccc494a1f51 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4044d070-c870-4edd-a859-734d31902fc4 req-6cd26981-239f-4922-b9fc-1ccc494a1f51 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-4044d070-c870-4edd-a859-734d31902fc4 req-6cd26981-239f-4922-b9fc-1ccc494a1f51 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-unplugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:54:59 user nova-compute[74934]: WARNING nova.compute.manager [req-4044d070-c870-4edd-a859-734d31902fc4 req-6cd26981-239f-4922-b9fc-1ccc494a1f51 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-unplugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state active and task_state shelving.
Nov 19 14:54:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:54:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance destroyed successfully.
Nov 19 14:54:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:54:59 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:55:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:55:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:55:00 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deab1e7-4f3f-4b9f-81b3-0d99312f6cc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:55:00 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7fe60a-c7a9-45c5-9ce7-9ffa10415130]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b] added
Nov 19 14:55:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54624f8-40a2-44dc-8cc6-53acb83b8cfe]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9137775-1775-45d6-9455-310e34f33012]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPiLAcBj {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPiLAcBj" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667cd51-6683-4317-ab28-20ca6af7c407]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPiLAcBj'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbf058b-1fab-45ae-b5f7-d530d96388df]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7b1754-49cf-4f28-b562-3c7f23b97b7c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d71494-1cbd-4c1d-b145-8c6e9e2438fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]
Nov 19 14:55:00 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.
Nov 19 14:55:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb60282-da97-44fb-846c-b5c657ba7527]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a074d6a-66fd-444e-94d5-b4096252a5e2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:00 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c282d3-a72a-49a4-bfd2-0759080b5520]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance destroyed successfully.
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'resources' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1484735444',display_name='tempest-TestShelveInstance-server-1484735444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1484735444',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpFNOqUCNfVYd6dqGjV3IRxvVJqjXnkKpqMLcwHjKSGcWD2G2IiPCyXkGWFGmFXl/V6qoPJnZIuDxsE3q5wxqN0i2Hq2Iz6p2cfZVTDFoRT/hKvFziNFeIL0XLmR+9puw==',key_name='tempest-TestShelveInstance-1632405257',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='437e3d86ee8742cfba5cfe234a7cca84',ramdisk_id='',reservation_id='r-hyc90zbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1215943411',owner_user_name='tempest-TestShelveInstance-1215943411-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:53:23Z,user_data=None,user_id='63f4c7f018334c358470fe0104e709d1',uuid=f03aa92d-6048-4c69-b275-deed31447a37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converting VIF {"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG os_vif [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:55:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcea6ddd2-1d, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6791102e-9bf5-4f09-83e3-d68540c7fa30) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing instance network info cache due to event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:01 user nova-compute[74934]: INFO os_vif [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d')
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:55:01 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26233396162656631', 'path': '/dev/sdf'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233396162656631', 'path': '/dev/sdf'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.371s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updated VIF entry in instance network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": null, "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.objects.instance [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b04adf06-a092-4ce7-b447-9406788e016d req-229be48c-a422-46ee-ad6f-2e87146b7847 service nova] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5af866e-8dde-4cac-b449-853aa25c9251]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:55:01 user nova-compute[74934]: No targets found.
Nov 19 14:55:01 user nova-compute[74934]: iSNS:
Nov 19 14:55:01 user nova-compute[74934]: No targets found.
Nov 19 14:55:01 user nova-compute[74934]: STATIC:
Nov 19 14:55:01 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:55:01 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:55:01 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:55:01 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:55:01 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:55:01 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:55:01 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:55:01 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:55:01 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:55:01 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa
Nov 19 14:55:01 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:55:01 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:55:01 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:55:01 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:55:01 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:55:01 user nova-compute[74934]: FIRMWARE:
Nov 19 14:55:01 user nova-compute[74934]: No targets found.
Nov 19 14:55:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:55:01 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:55:01 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:55:01 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:55:01 user nova-compute[74934]:   <source dev="/dev/sdf"/>
Nov 19 14:55:01 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:55:01 user nova-compute[74934]:   <serial>ed26e3c0-5aab-4ea1-aa51-ad9e9475074b</serial>
Nov 19 14:55:01 user nova-compute[74934]: </disk>
Nov 19 14:55:01 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7846ee-22b6-41ea-9278-bedd15ca4511]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be5ff94-d871-463e-a025-485c7b0e3295]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:01 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4326560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01478ca-42c9-4ea6-b5b5-e053fd2966ba]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d4013-bb7f-4564-867f-b139236da3de]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[97006f05-652a-478e-b393-3df9441738f9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4badad3-9c8e-4ce4-8c79-b4d9165bd756]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a7c5ef-c729-41bd-ad7e-0b347f3dae3c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-0273a1c9-4f90-4642-b128-50dbffa040f5 req-ea0c4579-510b-415d-9f03-78dec8343c6c service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0273a1c9-4f90-4642-b128-50dbffa040f5 req-ea0c4579-510b-415d-9f03-78dec8343c6c service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0273a1c9-4f90-4642-b128-50dbffa040f5 req-ea0c4579-510b-415d-9f03-78dec8343c6c service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0273a1c9-4f90-4642-b128-50dbffa040f5 req-ea0c4579-510b-415d-9f03-78dec8343c6c service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-0273a1c9-4f90-4642-b128-50dbffa040f5 req-ea0c4579-510b-415d-9f03-78dec8343c6c service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:01 user nova-compute[74934]: WARNING nova.compute.manager [req-0273a1c9-4f90-4642-b128-50dbffa040f5 req-ea0c4579-510b-415d-9f03-78dec8343c6c service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state active and task_state shelving.
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3a0ec-a4c2-4d05-a7f8-33c2ce431a7b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]
Nov 19 14:55:01 user nova-compute[74934]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.
Nov 19 14:55:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba09c5-8e7e-4961-8f3d-e9be39e5b749]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] <== disconnect_volume: return (697ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:55:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Deleting instance files /opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37_del
Nov 19 14:55:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Deletion of /opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37_del complete
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No VIF found with MAC fa:16:3e:81:ed:9b, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:55:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-92c156dd-a45d-4ba5-b3d3-4e8f78351885 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.979s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:55:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74934) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 19 14:55:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:02 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Deleted allocations for instance f03aa92d-6048-4c69-b275-deed31447a37
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'numa_topology' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.objects.base [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Object Instance<f03aa92d-6048-4c69-b275-deed31447a37> lazy-loaded attributes: resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-699e7b02-2e6f-46fb-8999-32c14fe8f7ec req-b1320bc6-5849-41c2-b532-0d84c91b4bb3 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-699e7b02-2e6f-46fb-8999-32c14fe8f7ec req-b1320bc6-5849-41c2-b532-0d84c91b4bb3 service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-699e7b02-2e6f-46fb-8999-32c14fe8f7ec req-b1320bc6-5849-41c2-b532-0d84c91b4bb3 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-699e7b02-2e6f-46fb-8999-32c14fe8f7ec req-b1320bc6-5849-41c2-b532-0d84c91b4bb3 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-699e7b02-2e6f-46fb-8999-32c14fe8f7ec req-b1320bc6-5849-41c2-b532-0d84c91b4bb3 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:03 user nova-compute[74934]: WARNING nova.compute.manager [req-699e7b02-2e6f-46fb-8999-32c14fe8f7ec req-b1320bc6-5849-41c2-b532-0d84c91b4bb3 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state active and task_state powering-off.
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6bb5983e-bfae-4ad0-8943-14f1c453788c tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.275s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance destroyed successfully.
Nov 19 14:55:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:55:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ad6422c-d4db-4a32-afd7-499512822797 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.877s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-f25f58ad-0295-4c75-b0e6-f9e3a172d38f req-9dfa6a35-d3b0-4ea9-824a-07936a8754c0 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f25f58ad-0295-4c75-b0e6-f9e3a172d38f req-9dfa6a35-d3b0-4ea9-824a-07936a8754c0 service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f25f58ad-0295-4c75-b0e6-f9e3a172d38f req-9dfa6a35-d3b0-4ea9-824a-07936a8754c0 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f25f58ad-0295-4c75-b0e6-f9e3a172d38f req-9dfa6a35-d3b0-4ea9-824a-07936a8754c0 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-f25f58ad-0295-4c75-b0e6-f9e3a172d38f req-9dfa6a35-d3b0-4ea9-824a-07936a8754c0 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:05 user nova-compute[74934]: WARNING nova.compute.manager [req-f25f58ad-0295-4c75-b0e6-f9e3a172d38f req-9dfa6a35-d3b0-4ea9-824a-07936a8754c0 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state stopped and task_state None.
Nov 19 14:55:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "417da1fc-af51-4c8b-8257-666ba1882a97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:09 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:55:09 user nova-compute[74934]: INFO nova.compute.claims [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Claim successful on node user
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:55:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.policy [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0dcd4276cf8a406c9c4fe6416d1a6542', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6785ce4d07724430bc04f3b8fa17a17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:55:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Creating image(s)
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "/opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "/opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "/opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.221s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.211s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk 1073741824" returned: 0 in 0.063s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Successfully created port: e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Cannot resize image /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Ensure instance console log exists: /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Successfully updated port: e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "refresh_cache-417da1fc-af51-4c8b-8257-666ba1882a97" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquired lock "refresh_cache-417da1fc-af51-4c8b-8257-666ba1882a97" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-changed-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Refreshing instance network info cache due to event network-changed-e96f7c53-3895-4533-86e0-c708489515cf. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] Acquiring lock "refresh_cache-417da1fc-af51-4c8b-8257-666ba1882a97" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Updating instance_info_cache with network_info: [{"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Releasing lock "refresh_cache-417da1fc-af51-4c8b-8257-666ba1882a97" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Instance network_info: |[{"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] Acquired lock "refresh_cache-417da1fc-af51-4c8b-8257-666ba1882a97" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Refreshing network info cache for port e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Start _get_guest_xml network_info=[{"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:55:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-586399447',display_name='tempest-ServersNegativeTestJSON-server-586399447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-586399447',id=24,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6785ce4d07724430bc04f3b8fa17a17f',ramdisk_id='',reservation_id='r-dbwga6tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1797626430',owner_user_name='tempest-ServersNegativeTestJSON-1797626430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:11Z,user_data=None,user_id='0dcd4276cf8a406c9c4fe6416d1a6542',uuid=417da1fc-af51-4c8b-8257-666ba1882a97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converting VIF {"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.objects.instance [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lazy-loading 'pci_devices' on Instance uuid 417da1fc-af51-4c8b-8257-666ba1882a97 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:55:13 user nova-compute[74934]:   <uuid>417da1fc-af51-4c8b-8257-666ba1882a97</uuid>
Nov 19 14:55:13 user nova-compute[74934]:   <name>instance-00000018</name>
Nov 19 14:55:13 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:55:13 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:55:13 user nova-compute[74934]:   <metadata>
Nov 19 14:55:13 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:55:13 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:55:13 user nova-compute[74934]:       <nova:name>tempest-ServersNegativeTestJSON-server-586399447</nova:name>
Nov 19 14:55:13 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:55:13</nova:creationTime>
Nov 19 14:55:13 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:55:13 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:55:13 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:55:13 user nova-compute[74934]:       <nova:owner>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:user uuid="0dcd4276cf8a406c9c4fe6416d1a6542">tempest-ServersNegativeTestJSON-1797626430-project-member</nova:user>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:project uuid="6785ce4d07724430bc04f3b8fa17a17f">tempest-ServersNegativeTestJSON-1797626430</nova:project>
Nov 19 14:55:13 user nova-compute[74934]:       </nova:owner>
Nov 19 14:55:13 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:55:13 user nova-compute[74934]:       <nova:ports>
Nov 19 14:55:13 user nova-compute[74934]:         <nova:port uuid="e96f7c53-3895-4533-86e0-c708489515cf">
Nov 19 14:55:13 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 19 14:55:13 user nova-compute[74934]:         </nova:port>
Nov 19 14:55:13 user nova-compute[74934]:       </nova:ports>
Nov 19 14:55:13 user nova-compute[74934]:     </nova:instance>
Nov 19 14:55:13 user nova-compute[74934]:   </metadata>
Nov 19 14:55:13 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:55:13 user nova-compute[74934]:     <system>
Nov 19 14:55:13 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:55:13 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:55:13 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:55:13 user nova-compute[74934]:       <entry name="serial">417da1fc-af51-4c8b-8257-666ba1882a97</entry>
Nov 19 14:55:13 user nova-compute[74934]:       <entry name="uuid">417da1fc-af51-4c8b-8257-666ba1882a97</entry>
Nov 19 14:55:13 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:55:13 user nova-compute[74934]:     </system>
Nov 19 14:55:13 user nova-compute[74934]:   </sysinfo>
Nov 19 14:55:13 user nova-compute[74934]:   <os>
Nov 19 14:55:13 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:55:13 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:55:13 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:55:13 user nova-compute[74934]:   </os>
Nov 19 14:55:13 user nova-compute[74934]:   <features>
Nov 19 14:55:13 user nova-compute[74934]:     <acpi/>
Nov 19 14:55:13 user nova-compute[74934]:     <apic/>
Nov 19 14:55:13 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:55:13 user nova-compute[74934]:   </features>
Nov 19 14:55:13 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:55:13 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:55:13 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:55:13 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:55:13 user nova-compute[74934]:   </clock>
Nov 19 14:55:13 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:55:13 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:55:13 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:55:13 user nova-compute[74934]:   </cpu>
Nov 19 14:55:13 user nova-compute[74934]:   <devices>
Nov 19 14:55:13 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:55:13 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:55:13 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk"/>
Nov 19 14:55:13 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:55:13 user nova-compute[74934]:     </disk>
Nov 19 14:55:13 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:55:13 user nova-compute[74934]:       <mac address="fa:16:3e:4e:ef:85"/>
Nov 19 14:55:13 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:13 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:55:13 user nova-compute[74934]:       <target dev="tape96f7c53-38"/>
Nov 19 14:55:13 user nova-compute[74934]:     </interface>
Nov 19 14:55:13 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:55:13 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/console.log" append="off"/>
Nov 19 14:55:13 user nova-compute[74934]:     </serial>
Nov 19 14:55:13 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:55:13 user nova-compute[74934]:     <video>
Nov 19 14:55:13 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:13 user nova-compute[74934]:     </video>
Nov 19 14:55:13 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:55:13 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:55:13 user nova-compute[74934]:     </rng>
Nov 19 14:55:13 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:55:13 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:55:13 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:55:13 user nova-compute[74934]:     </memballoon>
Nov 19 14:55:13 user nova-compute[74934]:   </devices>
Nov 19 14:55:13 user nova-compute[74934]: </domain>
Nov 19 14:55:13 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-586399447',display_name='tempest-ServersNegativeTestJSON-server-586399447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-586399447',id=24,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6785ce4d07724430bc04f3b8fa17a17f',ramdisk_id='',reservation_id='r-dbwga6tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1797626430',owner_user_name='tempest-ServersNegativeTestJSON-1797626430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:11Z,user_data=None,user_id='0dcd4276cf8a406c9c4fe6416d1a6542',uuid=417da1fc-af51-4c8b-8257-666ba1882a97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converting VIF {"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG os_vif [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d224eea-5ae0-5319-bcc2-96ba94053a0d', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape96f7c53-38, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape96f7c53-38, col_values=(('qos', UUID('5bf793e8-178e-4fd0-8bbe-504e270d62e8')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape96f7c53-38, col_values=(('external_ids', {'iface-id': 'e96f7c53-3895-4533-86e0-c708489515cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:ef:85', 'vm-uuid': '417da1fc-af51-4c8b-8257-666ba1882a97'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:13 user nova-compute[74934]: INFO os_vif [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38')
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] No VIF found with MAC fa:16:3e:4e:ef:85, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Updated VIF entry in instance network info cache for port e96f7c53-3895-4533-86e0-c708489515cf. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Updating instance_info_cache with network_info: [{"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9e51e6e-c2fb-41b5-989b-d73be30818a8 req-7efb7301-b5f3-4bff-ba61-82850f8a2528 service nova] Releasing lock "refresh_cache-417da1fc-af51-4c8b-8257-666ba1882a97" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-changed-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Refreshing instance network info cache due to event network-changed-525b6c1f-c7bc-4084-9728-d49cb10e849c. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] Acquiring lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] Acquired lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Refreshing network info cache for port 525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updated VIF entry in instance network info cache for port 525b6c1f-c7bc-4084-9728-d49cb10e849c. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG nova.network.neutron [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updating instance_info_cache with network_info: [{"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1126009f-5a93-465d-b897-227c2892af9a req-c6956e51-2ca7-4a6f-80dd-abd1c3809e81 service nova] Releasing lock "refresh_cache-c5babe01-769c-495d-8e4b-de93e49bc012" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:55:15 user nova-compute[74934]: INFO nova.compute.claims [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Claim successful on node user
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:55:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.policy [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5935830106b34079a0d046897dac49ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f186c71871084693a14881dce4328b46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:55:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Creating image(s)
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:16 user nova-compute[74934]: DEBUG nova.objects.instance [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk 1073741824" returned: 0 in 0.053s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Successfully created port: 6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:17 user nova-compute[74934]: INFO nova.compute.manager [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Attaching volume 0aba1f0e-3122-4ac0-bb86-fe5def5939b5 to /dev/vdb
Nov 19 14:55:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Instance spawned successfully.
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG os_brick.utils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: INFO nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b7096d-ad94-4778-9c7a-ab37737cb354]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7066d73-7dd6-4fa6-9085-0588cef3245e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168ebeb-5ede-40c3-bfeb-d9bfa85398c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a65b3-0849-49a2-b5b6-f75ab2491496]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:17 user nova-compute[74934]: INFO nova.compute.manager [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Took 7.59 seconds to build instance.
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:55:17 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba570559-de3a-4020-a3bf-4b0f8fcdf7eb]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG os_brick.utils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updating existing volume attachment record: 0cb4ea16-a975-4fd4-b095-354bdeacf52d {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9608fa-2b90-4026-aa24-ef02f973ff47 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "417da1fc-af51-4c8b-8257-666ba1882a97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.704s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Cannot resize image /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Ensure instance console log exists: /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Successfully updated port: 6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-changed-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Refreshing instance network info cache due to event network-changed-6f242ee2-4b9e-4d39-9534-7cf20e355413. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:55:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance network_info: |[{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Refreshing network info cache for port 6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start _get_guest_xml network_info=[{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:55:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'pci_devices' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:55:18 user nova-compute[74934]:   <uuid>e7afb3a2-f158-4399-9fdb-82cdb44362e5</uuid>
Nov 19 14:55:18 user nova-compute[74934]:   <name>instance-00000019</name>
Nov 19 14:55:18 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:55:18 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:55:18 user nova-compute[74934]:   <metadata>
Nov 19 14:55:18 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:55:18 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:55:18 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherB-server-1516657562</nova:name>
Nov 19 14:55:18 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:55:18</nova:creationTime>
Nov 19 14:55:18 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:55:18 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:55:18 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:55:18 user nova-compute[74934]:       <nova:owner>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:user uuid="5935830106b34079a0d046897dac49ba">tempest-ServerActionsTestOtherB-868500136-project-member</nova:user>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:project uuid="f186c71871084693a14881dce4328b46">tempest-ServerActionsTestOtherB-868500136</nova:project>
Nov 19 14:55:18 user nova-compute[74934]:       </nova:owner>
Nov 19 14:55:18 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:55:18 user nova-compute[74934]:       <nova:ports>
Nov 19 14:55:18 user nova-compute[74934]:         <nova:port uuid="6f242ee2-4b9e-4d39-9534-7cf20e355413">
Nov 19 14:55:18 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 19 14:55:18 user nova-compute[74934]:         </nova:port>
Nov 19 14:55:18 user nova-compute[74934]:       </nova:ports>
Nov 19 14:55:18 user nova-compute[74934]:     </nova:instance>
Nov 19 14:55:18 user nova-compute[74934]:   </metadata>
Nov 19 14:55:18 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:55:18 user nova-compute[74934]:     <system>
Nov 19 14:55:18 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:55:18 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:55:18 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:55:18 user nova-compute[74934]:       <entry name="serial">e7afb3a2-f158-4399-9fdb-82cdb44362e5</entry>
Nov 19 14:55:18 user nova-compute[74934]:       <entry name="uuid">e7afb3a2-f158-4399-9fdb-82cdb44362e5</entry>
Nov 19 14:55:18 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:55:18 user nova-compute[74934]:     </system>
Nov 19 14:55:18 user nova-compute[74934]:   </sysinfo>
Nov 19 14:55:18 user nova-compute[74934]:   <os>
Nov 19 14:55:18 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:55:18 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:55:18 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:55:18 user nova-compute[74934]:   </os>
Nov 19 14:55:18 user nova-compute[74934]:   <features>
Nov 19 14:55:18 user nova-compute[74934]:     <acpi/>
Nov 19 14:55:18 user nova-compute[74934]:     <apic/>
Nov 19 14:55:18 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:55:18 user nova-compute[74934]:   </features>
Nov 19 14:55:18 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:55:18 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:55:18 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:55:18 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:55:18 user nova-compute[74934]:   </clock>
Nov 19 14:55:18 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:55:18 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:55:18 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:55:18 user nova-compute[74934]:   </cpu>
Nov 19 14:55:18 user nova-compute[74934]:   <devices>
Nov 19 14:55:18 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:55:18 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:55:18 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk"/>
Nov 19 14:55:18 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:55:18 user nova-compute[74934]:     </disk>
Nov 19 14:55:18 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:55:18 user nova-compute[74934]:       <mac address="fa:16:3e:84:28:56"/>
Nov 19 14:55:18 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:18 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:55:18 user nova-compute[74934]:       <target dev="tap6f242ee2-4b"/>
Nov 19 14:55:18 user nova-compute[74934]:     </interface>
Nov 19 14:55:18 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:55:18 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/console.log" append="off"/>
Nov 19 14:55:18 user nova-compute[74934]:     </serial>
Nov 19 14:55:18 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:55:18 user nova-compute[74934]:     <video>
Nov 19 14:55:18 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:18 user nova-compute[74934]:     </video>
Nov 19 14:55:18 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:55:18 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:55:18 user nova-compute[74934]:     </rng>
Nov 19 14:55:18 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:55:18 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:55:18 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:55:18 user nova-compute[74934]:     </memballoon>
Nov 19 14:55:18 user nova-compute[74934]:   </devices>
Nov 19 14:55:18 user nova-compute[74934]: </domain>
Nov 19 14:55:18 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG os_vif [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '692b2f3d-3784-55a0-8709-dbcc69b3499a', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f242ee2-4b, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f242ee2-4b, col_values=(('qos', UUID('994ba579-94ee-4a0a-bea5-0a83fc9c3f4c')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f242ee2-4b, col_values=(('external_ids', {'iface-id': '6f242ee2-4b9e-4d39-9534-7cf20e355413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:28:56', 'vm-uuid': 'e7afb3a2-f158-4399-9fdb-82cdb44362e5'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-648f6926-2e26-4217-89e2-c9958f2ac8d8 req-b3641fb3-6e31-4677-9229-bdf8804b390f service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-648f6926-2e26-4217-89e2-c9958f2ac8d8 req-b3641fb3-6e31-4677-9229-bdf8804b390f service nova] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-648f6926-2e26-4217-89e2-c9958f2ac8d8 req-b3641fb3-6e31-4677-9229-bdf8804b390f service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-648f6926-2e26-4217-89e2-c9958f2ac8d8 req-b3641fb3-6e31-4677-9229-bdf8804b390f service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-648f6926-2e26-4217-89e2-c9958f2ac8d8 req-b3641fb3-6e31-4677-9229-bdf8804b390f service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] No waiting events found dispatching network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:18 user nova-compute[74934]: WARNING nova.compute.manager [req-648f6926-2e26-4217-89e2-c9958f2ac8d8 req-b3641fb3-6e31-4677-9229-bdf8804b390f service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received unexpected event network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf for instance with vm_state active and task_state None.
Nov 19 14:55:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:18 user nova-compute[74934]: INFO os_vif [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b')
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No VIF found with MAC fa:16:3e:84:28:56, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updated VIF entry in instance network info cache for port 6f242ee2-4b9e-4d39-9534-7cf20e355413. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-69411b89-0ae2-4473-877c-9113d00f7687 req-0216f1e8-8c40-4306-9817-ea8e7baef518 service nova] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-7aef5395-3d47-4eb7-9507-e627f203ed8c req-f2351e53-678b-4fc3-b765-2a6eeda68b67 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7aef5395-3d47-4eb7-9507-e627f203ed8c req-f2351e53-678b-4fc3-b765-2a6eeda68b67 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7aef5395-3d47-4eb7-9507-e627f203ed8c req-f2351e53-678b-4fc3-b765-2a6eeda68b67 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7aef5395-3d47-4eb7-9507-e627f203ed8c req-f2351e53-678b-4fc3-b765-2a6eeda68b67 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-7aef5395-3d47-4eb7-9507-e627f203ed8c req-f2351e53-678b-4fc3-b765-2a6eeda68b67 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:20 user nova-compute[74934]: WARNING nova.compute.manager [req-7aef5395-3d47-4eb7-9507-e627f203ed8c req-f2351e53-678b-4fc3-b765-2a6eeda68b67 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state building and task_state spawning.
Nov 19 14:55:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ae5b18cc-9979-4d3d-8b54-8a171f5af713 req-a8acde5a-f542-425a-b7ef-0e3561163ac9 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ae5b18cc-9979-4d3d-8b54-8a171f5af713 req-a8acde5a-f542-425a-b7ef-0e3561163ac9 service nova] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ae5b18cc-9979-4d3d-8b54-8a171f5af713 req-a8acde5a-f542-425a-b7ef-0e3561163ac9 service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ae5b18cc-9979-4d3d-8b54-8a171f5af713 req-a8acde5a-f542-425a-b7ef-0e3561163ac9 service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ae5b18cc-9979-4d3d-8b54-8a171f5af713 req-a8acde5a-f542-425a-b7ef-0e3561163ac9 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] No waiting events found dispatching network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:20 user nova-compute[74934]: WARNING nova.compute.manager [req-ae5b18cc-9979-4d3d-8b54-8a171f5af713 req-a8acde5a-f542-425a-b7ef-0e3561163ac9 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received unexpected event network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf for instance with vm_state active and task_state None.
Nov 19 14:55:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:55:22 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance spawned successfully.
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-fd47785a-ab2c-4fad-9f66-2930b33ee9fc req-5f18ada1-c836-4a9a-9bda-6484147b8609 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fd47785a-ab2c-4fad-9f66-2930b33ee9fc req-5f18ada1-c836-4a9a-9bda-6484147b8609 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fd47785a-ab2c-4fad-9f66-2930b33ee9fc req-5f18ada1-c836-4a9a-9bda-6484147b8609 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fd47785a-ab2c-4fad-9f66-2930b33ee9fc req-5f18ada1-c836-4a9a-9bda-6484147b8609 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-fd47785a-ab2c-4fad-9f66-2930b33ee9fc req-5f18ada1-c836-4a9a-9bda-6484147b8609 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:22 user nova-compute[74934]: WARNING nova.compute.manager [req-fd47785a-ab2c-4fad-9f66-2930b33ee9fc req-5f18ada1-c836-4a9a-9bda-6484147b8609 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state building and task_state spawning.
Nov 19 14:55:22 user nova-compute[74934]: INFO nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 19 14:55:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:55:22 user nova-compute[74934]: INFO nova.compute.manager [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Took 6.44 seconds to build instance.
Nov 19 14:55:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d2a6f9b-bce6-45ce-b9f5-828517676e7b tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.598s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIxmQOFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:55:23 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:55:23 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:55:23 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d28292-3c10-4cf1-8d11-2211b9e5aead]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:55:23 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1d8b1-6c19-450c-9a4b-1b50d008dc67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5] added
Nov 19 14:55:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e5b9f9-113e-41a9-9398-064306c31b7b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5fbb08-2821-4df3-94b1-49546817595d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIxmQOFr {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIxmQOFr" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f30e82-9dc8-4997-80ab-ac175f822b6b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIxmQOFr'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc477d-18ce-48db-9a9b-bd83e2d1eaf2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[56263053-83a6-4339-8613-81be7a0c26a2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1348472-aa7c-4670-9cdb-531a202cadb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260]
Nov 19 14:55:23 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260] successful.
Nov 19 14:55:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7672fd7-78d3-4361-8eaf-ebb392d508a1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e566af-0608-4654-92d9-6dd8641a209e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:55:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:55:23 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:55:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[741ba42c-7b21-4dd6-b214-de74ce57e823]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:55:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIxmQOFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23332373063383632', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332373063383632', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG nova.objects.instance [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:55:24 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:55:24 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 14:55:24 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:55:24 user nova-compute[74934]:   <serial>0aba1f0e-3122-4ac0-bb86-fe5def5939b5</serial>
Nov 19 14:55:24 user nova-compute[74934]: </disk>
Nov 19 14:55:24 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:55:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:75:60:00, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:55:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7eac5529-6e6d-43ef-9e41-2a175e6e456e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.124s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:28 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:55:28 user nova-compute[74934]: INFO nova.compute.claims [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Claim successful on node user
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:55:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.policy [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124c5ebfa08e42e49e2e9d244103a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8926ff675c045458069f7b4e1ebc656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:55:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Creating image(s)
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk 1073741824" returned: 0 in 0.074s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Successfully created port: 0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Cannot resize image /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Ensure instance console log exists: /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Successfully updated port: 0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquired lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-changed-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Refreshing instance network info cache due to event network-changed-0464bf6f-4d6b-4f51-aa17-d450f0bb3878. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:55:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] Acquiring lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Updating instance_info_cache with network_info: [{"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Releasing lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Instance network_info: |[{"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] Acquired lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.neutron [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Refreshing network info cache for port 0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Start _get_guest_xml network_info=[{"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:55:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1440162874',display_name='tempest-AttachVolumeNegativeTest-server-1440162874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1440162874',id=26,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODHBVAj22SRGi8LfaqBfANO/BDmvgXBv53R1fI2aZd076UVZALF+VTdxnDq0lC6w/Wk65KZK9dVnJz33toiPGuQ3hTV2Rg9dv0ZjEa1i13xlBPYpco79mRiWhyTQSMjzw==',key_name='tempest-keypair-158451627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-ckdlazyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=9c47cca7-32d5-44a6-8347-5138a98473fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c47cca7-32d5-44a6-8347-5138a98473fc {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:55:31 user nova-compute[74934]:   <uuid>9c47cca7-32d5-44a6-8347-5138a98473fc</uuid>
Nov 19 14:55:31 user nova-compute[74934]:   <name>instance-0000001a</name>
Nov 19 14:55:31 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:55:31 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:55:31 user nova-compute[74934]:   <metadata>
Nov 19 14:55:31 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:55:31 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:55:31 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1440162874</nova:name>
Nov 19 14:55:31 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:55:31</nova:creationTime>
Nov 19 14:55:31 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:55:31 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:55:31 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:55:31 user nova-compute[74934]:       <nova:owner>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:user uuid="124c5ebfa08e42e49e2e9d244103a1f4">tempest-AttachVolumeNegativeTest-661612303-project-member</nova:user>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:project uuid="a8926ff675c045458069f7b4e1ebc656">tempest-AttachVolumeNegativeTest-661612303</nova:project>
Nov 19 14:55:31 user nova-compute[74934]:       </nova:owner>
Nov 19 14:55:31 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:55:31 user nova-compute[74934]:       <nova:ports>
Nov 19 14:55:31 user nova-compute[74934]:         <nova:port uuid="0464bf6f-4d6b-4f51-aa17-d450f0bb3878">
Nov 19 14:55:31 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 19 14:55:31 user nova-compute[74934]:         </nova:port>
Nov 19 14:55:31 user nova-compute[74934]:       </nova:ports>
Nov 19 14:55:31 user nova-compute[74934]:     </nova:instance>
Nov 19 14:55:31 user nova-compute[74934]:   </metadata>
Nov 19 14:55:31 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:55:31 user nova-compute[74934]:     <system>
Nov 19 14:55:31 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:55:31 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:55:31 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:55:31 user nova-compute[74934]:       <entry name="serial">9c47cca7-32d5-44a6-8347-5138a98473fc</entry>
Nov 19 14:55:31 user nova-compute[74934]:       <entry name="uuid">9c47cca7-32d5-44a6-8347-5138a98473fc</entry>
Nov 19 14:55:31 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:55:31 user nova-compute[74934]:     </system>
Nov 19 14:55:31 user nova-compute[74934]:   </sysinfo>
Nov 19 14:55:31 user nova-compute[74934]:   <os>
Nov 19 14:55:31 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:55:31 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:55:31 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:55:31 user nova-compute[74934]:   </os>
Nov 19 14:55:31 user nova-compute[74934]:   <features>
Nov 19 14:55:31 user nova-compute[74934]:     <acpi/>
Nov 19 14:55:31 user nova-compute[74934]:     <apic/>
Nov 19 14:55:31 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:55:31 user nova-compute[74934]:   </features>
Nov 19 14:55:31 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:55:31 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:55:31 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:55:31 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:55:31 user nova-compute[74934]:   </clock>
Nov 19 14:55:31 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:55:31 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:55:31 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:55:31 user nova-compute[74934]:   </cpu>
Nov 19 14:55:31 user nova-compute[74934]:   <devices>
Nov 19 14:55:31 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:55:31 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:55:31 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk"/>
Nov 19 14:55:31 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:55:31 user nova-compute[74934]:     </disk>
Nov 19 14:55:31 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:55:31 user nova-compute[74934]:       <mac address="fa:16:3e:0b:05:38"/>
Nov 19 14:55:31 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:31 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:55:31 user nova-compute[74934]:       <target dev="tap0464bf6f-4d"/>
Nov 19 14:55:31 user nova-compute[74934]:     </interface>
Nov 19 14:55:31 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:55:31 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/console.log" append="off"/>
Nov 19 14:55:31 user nova-compute[74934]:     </serial>
Nov 19 14:55:31 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:55:31 user nova-compute[74934]:     <video>
Nov 19 14:55:31 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:31 user nova-compute[74934]:     </video>
Nov 19 14:55:31 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:55:31 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:55:31 user nova-compute[74934]:     </rng>
Nov 19 14:55:31 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:55:31 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:55:31 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:55:31 user nova-compute[74934]:     </memballoon>
Nov 19 14:55:31 user nova-compute[74934]:   </devices>
Nov 19 14:55:31 user nova-compute[74934]: </domain>
Nov 19 14:55:31 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1440162874',display_name='tempest-AttachVolumeNegativeTest-server-1440162874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1440162874',id=26,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODHBVAj22SRGi8LfaqBfANO/BDmvgXBv53R1fI2aZd076UVZALF+VTdxnDq0lC6w/Wk65KZK9dVnJz33toiPGuQ3hTV2Rg9dv0ZjEa1i13xlBPYpco79mRiWhyTQSMjzw==',key_name='tempest-keypair-158451627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-ckdlazyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=9c47cca7-32d5-44a6-8347-5138a98473fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG os_vif [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '097ee7ba-f47c-59c0-be1f-83465b9814e7', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0464bf6f-4d, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0464bf6f-4d, col_values=(('qos', UUID('2aeaca0e-8b92-44b5-89df-b7e3c347a82c')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0464bf6f-4d, col_values=(('external_ids', {'iface-id': '0464bf6f-4d6b-4f51-aa17-d450f0bb3878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:05:38', 'vm-uuid': '9c47cca7-32d5-44a6-8347-5138a98473fc'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:31 user nova-compute[74934]: INFO os_vif [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d')
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:0b:05:38, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:55:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Updated VIF entry in instance network info cache for port 0464bf6f-4d6b-4f51-aa17-d450f0bb3878. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:55:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Updating instance_info_cache with network_info: [{"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-36da9e83-c083-4093-9699-fb0407fb3441 req-aa56eaa5-8cfa-4fd2-ac7f-e1b67b69d5be service nova] Releasing lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-75475e20-7167-42f3-aa3b-a1bb5b73ca6a req-0bc0dab6-2e58-47f4-af68-43eaf38a1b43 service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-75475e20-7167-42f3-aa3b-a1bb5b73ca6a req-0bc0dab6-2e58-47f4-af68-43eaf38a1b43 service nova] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-75475e20-7167-42f3-aa3b-a1bb5b73ca6a req-0bc0dab6-2e58-47f4-af68-43eaf38a1b43 service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-75475e20-7167-42f3-aa3b-a1bb5b73ca6a req-0bc0dab6-2e58-47f4-af68-43eaf38a1b43 service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-75475e20-7167-42f3-aa3b-a1bb5b73ca6a req-0bc0dab6-2e58-47f4-af68-43eaf38a1b43 service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] No waiting events found dispatching network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:33 user nova-compute[74934]: WARNING nova.compute.manager [req-75475e20-7167-42f3-aa3b-a1bb5b73ca6a req-0bc0dab6-2e58-47f4-af68-43eaf38a1b43 service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received unexpected event network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 for instance with vm_state building and task_state spawning.
Nov 19 14:55:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:55:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:34 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:55:34 user nova-compute[74934]: INFO nova.compute.claims [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Claim successful on node user
Nov 19 14:55:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:55:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.policy [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef44dc0981394f5fb42de977994f483d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1735667909d4b3e94e6be7ba9a5ec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:55:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Creating image(s)
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:55:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Instance spawned successfully.
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-b6af6e6f-2268-47e4-884f-0f06389ff686 req-945f63e1-d934-4732-9564-446711f22648 service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b6af6e6f-2268-47e4-884f-0f06389ff686 req-945f63e1-d934-4732-9564-446711f22648 service nova] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b6af6e6f-2268-47e4-884f-0f06389ff686 req-945f63e1-d934-4732-9564-446711f22648 service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b6af6e6f-2268-47e4-884f-0f06389ff686 req-945f63e1-d934-4732-9564-446711f22648 service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-b6af6e6f-2268-47e4-884f-0f06389ff686 req-945f63e1-d934-4732-9564-446711f22648 service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] No waiting events found dispatching network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:35 user nova-compute[74934]: WARNING nova.compute.manager [req-b6af6e6f-2268-47e4-884f-0f06389ff686 req-945f63e1-d934-4732-9564-446711f22648 service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received unexpected event network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 for instance with vm_state building and task_state spawning.
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:35 user nova-compute[74934]: INFO nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 19 14:55:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:55:35 user nova-compute[74934]: INFO nova.compute.manager [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Took 7.14 seconds to build instance.
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07d655c-489c-4d14-93cb-d11d4ed4def0 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.251s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.244s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk 1073741824" returned: 0 in 0.050s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Successfully created port: ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Cannot resize image /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Ensure instance console log exists: /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Successfully updated port: ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing instance network info cache due to event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance network_info: |[{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:55:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Start _get_guest_xml network_info=[{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:55:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1000508196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1000508196',id=27,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF52SJ24KTJ0lnzWRi8r66UQRZE0Nq+Tz/L+Qyegc5jvTCJzi3W3/p965wktN/fjJMaQSnGmtvBKzOO5CEabYrkYGC+m202XNwa9G6Rxk3CQ159oDFocUHAeSc8FMuFrjQ==',key_name='tempest-keypair-993746842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-3hfbw7e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'pci_devices' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:55:37 user nova-compute[74934]:   <uuid>60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96</uuid>
Nov 19 14:55:37 user nova-compute[74934]:   <name>instance-0000001b</name>
Nov 19 14:55:37 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:55:37 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:55:37 user nova-compute[74934]:   <metadata>
Nov 19 14:55:37 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:55:37 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:55:37 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1000508196</nova:name>
Nov 19 14:55:37 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:55:37</nova:creationTime>
Nov 19 14:55:37 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:55:37 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:55:37 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:55:37 user nova-compute[74934]:       <nova:owner>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:user uuid="ef44dc0981394f5fb42de977994f483d">tempest-AttachVolumeShelveTestJSON-884997441-project-member</nova:user>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:project uuid="f1735667909d4b3e94e6be7ba9a5ec7f">tempest-AttachVolumeShelveTestJSON-884997441</nova:project>
Nov 19 14:55:37 user nova-compute[74934]:       </nova:owner>
Nov 19 14:55:37 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:55:37 user nova-compute[74934]:       <nova:ports>
Nov 19 14:55:37 user nova-compute[74934]:         <nova:port uuid="ec88e767-be72-49c4-94a8-56d54e43569f">
Nov 19 14:55:37 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 19 14:55:37 user nova-compute[74934]:         </nova:port>
Nov 19 14:55:37 user nova-compute[74934]:       </nova:ports>
Nov 19 14:55:37 user nova-compute[74934]:     </nova:instance>
Nov 19 14:55:37 user nova-compute[74934]:   </metadata>
Nov 19 14:55:37 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:55:37 user nova-compute[74934]:     <system>
Nov 19 14:55:37 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:55:37 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:55:37 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:55:37 user nova-compute[74934]:       <entry name="serial">60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96</entry>
Nov 19 14:55:37 user nova-compute[74934]:       <entry name="uuid">60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96</entry>
Nov 19 14:55:37 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:55:37 user nova-compute[74934]:     </system>
Nov 19 14:55:37 user nova-compute[74934]:   </sysinfo>
Nov 19 14:55:37 user nova-compute[74934]:   <os>
Nov 19 14:55:37 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:55:37 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:55:37 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:55:37 user nova-compute[74934]:   </os>
Nov 19 14:55:37 user nova-compute[74934]:   <features>
Nov 19 14:55:37 user nova-compute[74934]:     <acpi/>
Nov 19 14:55:37 user nova-compute[74934]:     <apic/>
Nov 19 14:55:37 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:55:37 user nova-compute[74934]:   </features>
Nov 19 14:55:37 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:55:37 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:55:37 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:55:37 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:55:37 user nova-compute[74934]:   </clock>
Nov 19 14:55:37 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:55:37 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:55:37 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:55:37 user nova-compute[74934]:   </cpu>
Nov 19 14:55:37 user nova-compute[74934]:   <devices>
Nov 19 14:55:37 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:55:37 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:55:37 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk"/>
Nov 19 14:55:37 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:55:37 user nova-compute[74934]:     </disk>
Nov 19 14:55:37 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:55:37 user nova-compute[74934]:       <mac address="fa:16:3e:e1:01:04"/>
Nov 19 14:55:37 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:37 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:55:37 user nova-compute[74934]:       <target dev="tapec88e767-be"/>
Nov 19 14:55:37 user nova-compute[74934]:     </interface>
Nov 19 14:55:37 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:55:37 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/console.log" append="off"/>
Nov 19 14:55:37 user nova-compute[74934]:     </serial>
Nov 19 14:55:37 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:55:37 user nova-compute[74934]:     <video>
Nov 19 14:55:37 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:55:37 user nova-compute[74934]:     </video>
Nov 19 14:55:37 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:55:37 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:55:37 user nova-compute[74934]:     </rng>
Nov 19 14:55:37 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:55:37 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:55:37 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:55:37 user nova-compute[74934]:     </memballoon>
Nov 19 14:55:37 user nova-compute[74934]:   </devices>
Nov 19 14:55:37 user nova-compute[74934]: </domain>
Nov 19 14:55:37 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1000508196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1000508196',id=27,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF52SJ24KTJ0lnzWRi8r66UQRZE0Nq+Tz/L+Qyegc5jvTCJzi3W3/p965wktN/fjJMaQSnGmtvBKzOO5CEabYrkYGC+m202XNwa9G6Rxk3CQ159oDFocUHAeSc8FMuFrjQ==',key_name='tempest-keypair-993746842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-3hfbw7e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG os_vif [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cf7dae1-1a06-5f16-9448-e8fe7565e033', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec88e767-be, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec88e767-be, col_values=(('qos', UUID('8170b81f-722a-4eca-a4d5-5e09ddb12314')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec88e767-be, col_values=(('external_ids', {'iface-id': 'ec88e767-be72-49c4-94a8-56d54e43569f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:01:04', 'vm-uuid': '60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:37 user nova-compute[74934]: INFO os_vif [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be')
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No VIF found with MAC fa:16:3e:e1:01:04, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updated VIF entry in instance network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:55:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1be56b81-9449-48bf-84c1-af1be778b75b req-1573f6f3-7d71-4aa4-9a16-7137a4e37458 service nova] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:55:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-1e5b14aa-41d8-4fd0-8c63-0fcd287d461f req-042c6c64-0c8e-4407-805c-94c542f740be service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1e5b14aa-41d8-4fd0-8c63-0fcd287d461f req-042c6c64-0c8e-4407-805c-94c542f740be service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1e5b14aa-41d8-4fd0-8c63-0fcd287d461f req-042c6c64-0c8e-4407-805c-94c542f740be service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1e5b14aa-41d8-4fd0-8c63-0fcd287d461f req-042c6c64-0c8e-4407-805c-94c542f740be service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-1e5b14aa-41d8-4fd0-8c63-0fcd287d461f req-042c6c64-0c8e-4407-805c-94c542f740be service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:39 user nova-compute[74934]: WARNING nova.compute.manager [req-1e5b14aa-41d8-4fd0-8c63-0fcd287d461f req-042c6c64-0c8e-4407-805c-94c542f740be service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state building and task_state spawning.
Nov 19 14:55:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7c58dfa-7cc6-4b2b-9a6d-1cd0dbac7428 req-98b594a5-88e5-4993-9a15-d54c37057773 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7c58dfa-7cc6-4b2b-9a6d-1cd0dbac7428 req-98b594a5-88e5-4993-9a15-d54c37057773 service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7c58dfa-7cc6-4b2b-9a6d-1cd0dbac7428 req-98b594a5-88e5-4993-9a15-d54c37057773 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7c58dfa-7cc6-4b2b-9a6d-1cd0dbac7428 req-98b594a5-88e5-4993-9a15-d54c37057773 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7c58dfa-7cc6-4b2b-9a6d-1cd0dbac7428 req-98b594a5-88e5-4993-9a15-d54c37057773 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:55:41 user nova-compute[74934]: WARNING nova.compute.manager [req-d7c58dfa-7cc6-4b2b-9a6d-1cd0dbac7428 req-98b594a5-88e5-4993-9a15-d54c37057773 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state building and task_state spawning.
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:55:41 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance spawned successfully.
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:55:41 user nova-compute[74934]: INFO nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 19 14:55:41 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:55:41 user nova-compute[74934]: INFO nova.compute.manager [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Took 6.75 seconds to build instance.
Nov 19 14:55:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0248d414-8e9e-4139-9052-66a0d25d14f9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.854s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:51 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:55:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:55:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:55:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6832MB free_disk=25.033294677734375GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fee595d0-5f2c-4e12-8806-b28e02675c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c5babe01-769c-495d-8e4b-de93e49bc012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 417da1fc-af51-4c8b-8257-666ba1882a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 9c47cca7-32d5-44a6-8347-5138a98473fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=14GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:56:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:56:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [{"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-ede07940-0d9c-41ce-8d54-8b1d042f4da2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:56:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-changed-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing instance network info cache due to event network-changed-469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:56:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:16 user nova-compute[74934]: DEBUG nova.network.neutron [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updated VIF entry in instance network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-457274fa-99a3-4e81-852e-e823ea0dc9a4 req-f65af35f-3fc1-4f15-9330-642ac0c99f5f service nova] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-changed-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing instance network info cache due to event network-changed-469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] Acquiring lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] Acquired lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Refreshing network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:17 user nova-compute[74934]: INFO nova.compute.manager [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Detaching volume 2511dc16-2c88-4638-ba43-e0a3636726fa
Nov 19 14:56:17 user nova-compute[74934]: INFO nova.virt.block_device [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Attempting to driver detach volume 2511dc16-2c88-4638-ba43-e0a3636726fa from mountpoint /dev/vdb
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Attempting to detach device vdb from instance fee595d0-5f2c-4e12-8806-b28e02675c74 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:56:17 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:17 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:56:17 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:56:17 user nova-compute[74934]:   <serial>2511dc16-2c88-4638-ba43-e0a3636726fa</serial>
Nov 19 14:56:17 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:56:17 user nova-compute[74934]: </disk>
Nov 19 14:56:17 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:56:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully detached device vdb from instance fee595d0-5f2c-4e12-8806-b28e02675c74 from the persistent domain config.
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fee595d0-5f2c-4e12-8806-b28e02675c74 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:56:17 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:17 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:56:17 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:56:17 user nova-compute[74934]:   <serial>2511dc16-2c88-4638-ba43-e0a3636726fa</serial>
Nov 19 14:56:17 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:56:17 user nova-compute[74934]: </disk>
Nov 19 14:56:17 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updated VIF entry in instance network info cache for port 469efd39-a7d3-4ba1-a81e-105842842227. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [{"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a0a5962-d983-4f4f-a415-60aafbd24864 req-7cd9e3c0-3bcc-459c-ad60-28cb4fc674e3 service nova] Releasing lock "refresh_cache-fee595d0-5f2c-4e12-8806-b28e02675c74" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:56:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'flavor' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:20 user nova-compute[74934]: INFO nova.compute.manager [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Attaching volume 8df2239b-b647-4fad-9dda-db5c994ab328 to /dev/vdb
Nov 19 14:56:20 user nova-compute[74934]: DEBUG os_brick.utils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[150065cc-351a-49bb-a699-041c7b5ab472]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[95441f59-1c96-4844-b51a-0679bfd19686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21b416-6a8b-4eff-a191-c92c2f2b3d4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a69002f-5981-4c58-9c57-6f12cff3421f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:56:20 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:56:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f2e46f-193a-4410-b8d0-21007c8283ab]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG os_brick.utils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:20 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating existing volume attachment record: 76ceaecd-c621-49f6-8663-5a24bd11a376 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:56:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrpudRbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:27 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:27 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:27 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[267ab8d7-3306-458e-808b-91ada6ba99a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:56:27 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5aebf7-2d2b-4b24-aa7b-59b4fb744f32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328] added
Nov 19 14:56:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a581b354-d0e1-4157-be7d-f9f23510b6da]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfa8b69-184a-4129-a9c3-8146b55268d2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrpudRbs {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrpudRbs" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d724edc5-93e9-4f58-8cca-9708599cc390]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrpudRbs'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d97bc06-8dc3-4296-b9a0-9643b7f54024]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a05b4-10d8-4284-8095-c8ecf7049a5d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[279676ba-fc75-40ab-bae1-194b429aa48c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260]
Nov 19 14:56:27 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260] successful.
Nov 19 14:56:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84445e3-50c6-4611-b152-431a85699cd2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa30b5e-8d49-4b9f-8ad7-dcaea9f08757]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[87427d07-74e9-49c5-adfd-aad7a6226af8]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:56:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrpudRbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26537646435373564', 'path': '/dev/sdg'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537646435373564', 'path': '/dev/sdg'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'flavor' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:56:28 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:28 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 14:56:28 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:56:28 user nova-compute[74934]:   <serial>8df2239b-b647-4fad-9dda-db5c994ab328</serial>
Nov 19 14:56:28 user nova-compute[74934]: </disk>
Nov 19 14:56:28 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No VIF found with MAC fa:16:3e:ac:cf:bf, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:56:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a6c190ee-aafc-4693-824a-1b7cb3426250 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.621s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:30 user nova-compute[74934]: INFO nova.compute.manager [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Rescuing
Nov 19 14:56:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-fceeb2c8-0000-403e-8140-d0a9f0b5e74d req-efa66d29-07a9-477c-8877-c38233b82fb5 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fceeb2c8-0000-403e-8140-d0a9f0b5e74d req-efa66d29-07a9-477c-8877-c38233b82fb5 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fceeb2c8-0000-403e-8140-d0a9f0b5e74d req-efa66d29-07a9-477c-8877-c38233b82fb5 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fceeb2c8-0000-403e-8140-d0a9f0b5e74d req-efa66d29-07a9-477c-8877-c38233b82fb5 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-fceeb2c8-0000-403e-8140-d0a9f0b5e74d req-efa66d29-07a9-477c-8877-c38233b82fb5 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:31 user nova-compute[74934]: WARNING nova.compute.manager [req-fceeb2c8-0000-403e-8140-d0a9f0b5e74d req-efa66d29-07a9-477c-8877-c38233b82fb5 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state active and task_state rescuing.
Nov 19 14:56:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance destroyed successfully.
Nov 19 14:56:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Attempting a stable device rescue
Nov 19 14:56:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74934) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 14:56:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Creating image(s)
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "c743c33ec423c6a3c373fd04d398021af29251e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "c743c33ec423c6a3c373fd04d398021af29251e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:32 user nova-compute[74934]: DEBUG nova.virt.images [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] 63474bdc-b3bd-42ac-9fb5-f211ff243974 was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:56:32 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:56:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.part /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e3601b0-e37e-429b-babd-d364fdd4f7e4 req-f3feb18e-42d7-4228-b68d-a6b704025abc service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e3601b0-e37e-429b-babd-d364fdd4f7e4 req-f3feb18e-42d7-4228-b68d-a6b704025abc service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e3601b0-e37e-429b-babd-d364fdd4f7e4 req-f3feb18e-42d7-4228-b68d-a6b704025abc service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e3601b0-e37e-429b-babd-d364fdd4f7e4 req-f3feb18e-42d7-4228-b68d-a6b704025abc service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e3601b0-e37e-429b-babd-d364fdd4f7e4 req-f3feb18e-42d7-4228-b68d-a6b704025abc service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:33 user nova-compute[74934]: WARNING nova.compute.manager [req-2e3601b0-e37e-429b-babd-d364fdd4f7e4 req-f3feb18e-42d7-4228-b68d-a6b704025abc service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state active and task_state rescuing.
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.part /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.converted" returned: 0 in 0.507s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:56:33 user nova-compute[74934]: INFO nova.compute.claims [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Claim successful on node user
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "c743c33ec423c6a3c373fd04d398021af29251e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.912s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "c743c33ec423c6a3c373fd04d398021af29251e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "c743c33ec423c6a3c373fd04d398021af29251e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2 --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2 --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2,backing_fmt=raw /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2,backing_fmt=raw /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue" returned: 0 in 0.104s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "c743c33ec423c6a3c373fd04d398021af29251e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'migration_context' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Object Instance<7a6dc86f-e21c-4789-9433-34c25d9bf56b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Start _get_guest_xml network_info=[{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "vif_mac": "fa:16:3e:ac:cf:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '63474bdc-b3bd-42ac-9fb5-f211ff243974', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '76ceaecd-c621-49f6-8663-5a24bd11a376', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrpudRbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7a6dc86f-e21c-4789-9433-34c25d9bf56b', 'attached_at': '', 'detached_at': '', 'volume_id': '8df2239b-b647-4fad-9dda-db5c994ab328', 'serial': '8df2239b-b647-4fad-9dda-db5c994ab328'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'resources' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Object Instance<7a6dc86f-e21c-4789-9433-34c25d9bf56b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'numa_topology' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Object Instance<7a6dc86f-e21c-4789-9433-34c25d9bf56b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:33 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:33 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.objects.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Object Instance<7a6dc86f-e21c-4789-9433-34c25d9bf56b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrpudRbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:33 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:34 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:34 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[878159b6-69fe-423b-9612-1c363bd387e4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YrpudRbs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 19 14:56:34 user nova-compute[74934]: node.name = iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:56:34 user nova-compute[74934]: node.tpgt = -1
Nov 19 14:56:34 user nova-compute[74934]: node.startup = automatic
Nov 19 14:56:34 user nova-compute[74934]: node.leading_login = No
Nov 19 14:56:34 user nova-compute[74934]: iface.iscsi_ifacename = default
Nov 19 14:56:34 user nova-compute[74934]: iface.net_ifacename = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.ipaddress = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.prefix_len = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.hwaddress = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.transport_name = tcp
Nov 19 14:56:34 user nova-compute[74934]: iface.initiatorname = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.vlan_id = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.vlan_priority = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.vlan_state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.iface_num = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.mtu = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.port = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.bootproto = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.subnet_mask = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.gateway = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_alt_client_id_state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_alt_client_id = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_dns = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_learn_iqn = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_req_vendor_id_state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_vendor_id_state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_vendor_id = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.dhcp_slp_da = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.fragmentation = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.gratuitous_arp = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.incoming_forwarding = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.tos_state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.tos = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.ttl = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.delayed_ack = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.tcp_nagle = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.tcp_wsf_state = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.tcp_wsf = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.tcp_timer_scale = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.tcp_timestamp = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.redirect = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.def_task_mgmt_timeout = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.header_digest = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.data_digest = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.immediate_data = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.initial_r2t = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.data_seq_inorder = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.data_pdu_inorder = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.erl = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.max_receive_data_len = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.first_burst_len = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.max_outstanding_r2t = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.max_burst_len = 0
Nov 19 14:56:34 user nova-compute[74934]: iface.chap_auth = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.bidi_chap = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.strict_login_compliance = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.discovery_auth = <empty>
Nov 19 14:56:34 user nova-compute[74934]: iface.discovery_logout = <empty>
Nov 19 14:56:34 user nova-compute[74934]: node.discovery_address = <empty>
Nov 19 14:56:34 user nova-compute[74934]: node.discovery_port = 0
Nov 19 14:56:34 user nova-compute[74934]: node.discovery_type = static
Nov 19 14:56:34 user nova-compute[74934]: node.session.initial_cmdsn = 0
Nov 19 14:56:34 user nova-compute[74934]: node.session.initial_login_retry_max = 8
Nov 19 14:56:34 user nova-compute[74934]: node.session.xmit_thread_priority = -20
Nov 19 14:56:34 user nova-compute[74934]: node.session.cmds_max = 128
Nov 19 14:56:34 user nova-compute[74934]: node.session.queue_depth = 32
Nov 19 14:56:34 user nova-compute[74934]: node.session.nr_sessions = 1
Nov 19 14:56:34 user nova-compute[74934]: node.session.auth.authmethod = CHAP
Nov 19 14:56:34 user nova-compute[74934]: node.session.auth.username = YrpudRbs
Nov 19 14:56:34 user nova-compute[74934]: node.session.auth.password = ***
Nov 19 14:56:34 user nova-compute[74934]: node.session.auth.username_in = <empty>
Nov 19 14:56:34 user nova-compute[74934]: node.session.auth.password_in = <empty>
Nov 19 14:56:34 user nova-compute[74934]: node.session.auth.chap_algs = MD5
Nov 19 14:56:34 user nova-compute[74934]: node.session.timeo.replacement_timeout = 120
Nov 19 14:56:34 user nova-compute[74934]: node.session.err_timeo.abort_timeout = 15
Nov 19 14:56:34 user nova-compute[74934]: node.session.err_timeo.lu_reset_timeout = 30
Nov 19 14:56:34 user nova-compute[74934]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 19 14:56:34 user nova-compute[74934]: node.session.err_timeo.host_reset_timeout = 60
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.FastAbort = Yes
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.InitialR2T = No
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.ImmediateData = Yes
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.FirstBurstLength = 262144
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.MaxBurstLength = 16776192
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.DefaultTime2Retain = 0
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.DefaultTime2Wait = 2
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.MaxConnections = 1
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 19 14:56:34 user nova-compute[74934]: node.session.iscsi.ERL = 0
Nov 19 14:56:34 user nova-compute[74934]: node.session.scan = manual
Nov 19 14:56:34 user nova-compute[74934]: node.session.reopen_max = 0
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].address = 172.16.0.220
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].port = 3260
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].startup = manual
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].tcp.window_size = 524288
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].tcp.type_of_service = 0
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].timeo.logout_timeout = 15
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].timeo.login_timeout = 15
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].timeo.auth_timeout = 45
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].timeo.noop_out_interval = 5
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].timeo.noop_out_timeout = 5
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].iscsi.HeaderDigest = None
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].iscsi.DataDigest = None
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].iscsi.IFMarker = No
Nov 19 14:56:34 user nova-compute[74934]: node.conn[0].iscsi.OFMarker = No
Nov 19 14:56:34 user nova-compute[74934]: # END RECORD
Nov 19 14:56:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0128b970-2d1c-4734-b780-6fadb5fca09e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4879281-480a-4ae5-8200-b55d55ba6e38]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrpudRbs {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrpudRbs" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae78614-6883-4263-9c6f-cad6b13ff452]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrpudRbs'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5397ef-f13b-4151-8944-d34e0bcac3c0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae602851-b5e0-4fe4-839b-5e9188eabd08]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:34 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:34 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.193s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] HCTL ('38', '0', '0', 0) found on session 25 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df85cd7a-8a25-4bac-b743-ad4c707afdfc]: (4, ('0 0 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Searching for a device in session 25 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrpudRbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.222s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] <== connect_volume: return (224ms) {'type': 'block', 'scsi_wwn': '26537646435373564', 'path': '/dev/sdg'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537646435373564', 'path': '/dev/sdg'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.031s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:56:34 user nova-compute[74934]: INFO nova.compute.claims [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Claim successful on node user
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-803844216',display_name='tempest-ServerStableDeviceRescueTest-server-803844216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-803844216',id=19,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUbox5HSED7xpC7HcwUxHh/0v35TaeuRy2gcdD681u/N7L38YKqkTpHVLzJoGUNAcIKZPP/OmcGQYj0Ngko9361NpsKRyRpRFAzbO082DLyeyxZ3E1zPTtP7eszn4HUXQ==',key_name='tempest-keypair-1912348231',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c990d55cb669477a9e76605b29869641',ramdisk_id='',reservation_id='r-8k3ev66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-183407110',owner_user_name='tempest-ServerStableDeviceRescueTest-183407110-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992c2896dd1540d3b8d85928c7125cdb',uuid=7a6dc86f-e21c-4789-9433-34c25d9bf56b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "vif_mac": "fa:16:3e:ac:cf:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converting VIF {"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "vif_mac": "fa:16:3e:ac:cf:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.objects.base [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Object Instance<7a6dc86f-e21c-4789-9433-34c25d9bf56b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:56:34 user nova-compute[74934]:   <uuid>7a6dc86f-e21c-4789-9433-34c25d9bf56b</uuid>
Nov 19 14:56:34 user nova-compute[74934]:   <name>instance-00000013</name>
Nov 19 14:56:34 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:56:34 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:56:34 user nova-compute[74934]:   <metadata>
Nov 19 14:56:34 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:56:34 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:56:34 user nova-compute[74934]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-803844216</nova:name>
Nov 19 14:56:34 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:56:33</nova:creationTime>
Nov 19 14:56:34 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:56:34 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:56:34 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:56:34 user nova-compute[74934]:       <nova:owner>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:user uuid="992c2896dd1540d3b8d85928c7125cdb">tempest-ServerStableDeviceRescueTest-183407110-project-member</nova:user>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:project uuid="c990d55cb669477a9e76605b29869641">tempest-ServerStableDeviceRescueTest-183407110</nova:project>
Nov 19 14:56:34 user nova-compute[74934]:       </nova:owner>
Nov 19 14:56:34 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:56:34 user nova-compute[74934]:       <nova:ports>
Nov 19 14:56:34 user nova-compute[74934]:         <nova:port uuid="d8a80afc-d141-4ca8-a0b3-b0374f579f17">
Nov 19 14:56:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:56:34 user nova-compute[74934]:         </nova:port>
Nov 19 14:56:34 user nova-compute[74934]:       </nova:ports>
Nov 19 14:56:34 user nova-compute[74934]:     </nova:instance>
Nov 19 14:56:34 user nova-compute[74934]:   </metadata>
Nov 19 14:56:34 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:56:34 user nova-compute[74934]:     <system>
Nov 19 14:56:34 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:56:34 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:56:34 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:56:34 user nova-compute[74934]:       <entry name="serial">7a6dc86f-e21c-4789-9433-34c25d9bf56b</entry>
Nov 19 14:56:34 user nova-compute[74934]:       <entry name="uuid">7a6dc86f-e21c-4789-9433-34c25d9bf56b</entry>
Nov 19 14:56:34 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:56:34 user nova-compute[74934]:     </system>
Nov 19 14:56:34 user nova-compute[74934]:   </sysinfo>
Nov 19 14:56:34 user nova-compute[74934]:   <os>
Nov 19 14:56:34 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:56:34 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:56:34 user nova-compute[74934]:   </os>
Nov 19 14:56:34 user nova-compute[74934]:   <features>
Nov 19 14:56:34 user nova-compute[74934]:     <acpi/>
Nov 19 14:56:34 user nova-compute[74934]:     <apic/>
Nov 19 14:56:34 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:56:34 user nova-compute[74934]:   </features>
Nov 19 14:56:34 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:56:34 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:56:34 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:56:34 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:56:34 user nova-compute[74934]:   </clock>
Nov 19 14:56:34 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:56:34 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:56:34 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:56:34 user nova-compute[74934]:   </cpu>
Nov 19 14:56:34 user nova-compute[74934]:   <devices>
Nov 19 14:56:34 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:56:34 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:56:34 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk"/>
Nov 19 14:56:34 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:56:34 user nova-compute[74934]:     </disk>
Nov 19 14:56:34 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:56:34 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:34 user nova-compute[74934]:       <source dev="/dev/sdg"/>
Nov 19 14:56:34 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:56:34 user nova-compute[74934]:       <serial>8df2239b-b647-4fad-9dda-db5c994ab328</serial>
Nov 19 14:56:34 user nova-compute[74934]:     </disk>
Nov 19 14:56:34 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:56:34 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:56:34 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue"/>
Nov 19 14:56:34 user nova-compute[74934]:       <target dev="vdc" bus="virtio"/>
Nov 19 14:56:34 user nova-compute[74934]:       <boot order="1"/>
Nov 19 14:56:34 user nova-compute[74934]:     </disk>
Nov 19 14:56:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:56:34 user nova-compute[74934]:       <mac address="fa:16:3e:ac:cf:bf"/>
Nov 19 14:56:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:56:34 user nova-compute[74934]:       <target dev="tapd8a80afc-d1"/>
Nov 19 14:56:34 user nova-compute[74934]:     </interface>
Nov 19 14:56:34 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:56:34 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/console.log" append="off"/>
Nov 19 14:56:34 user nova-compute[74934]:     </serial>
Nov 19 14:56:34 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:56:34 user nova-compute[74934]:     <video>
Nov 19 14:56:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:34 user nova-compute[74934]:     </video>
Nov 19 14:56:34 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:56:34 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:56:34 user nova-compute[74934]:     </rng>
Nov 19 14:56:34 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:56:34 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:56:34 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:56:34 user nova-compute[74934]:     </memballoon>
Nov 19 14:56:34 user nova-compute[74934]:   </devices>
Nov 19 14:56:34 user nova-compute[74934]: </domain>
Nov 19 14:56:34 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:56:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance destroyed successfully.
Nov 19 14:56:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.policy [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e87a983281b3497781f13b9e3aafa55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be92c125fd34bef8e55fa83ef3d5f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] No VIF found with MAC fa:16:3e:ac:cf:bf, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:56:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Creating image(s)
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "/opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "/opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.253s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk 1073741824" returned: 0 in 0.068s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:34 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.903s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.069s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:56:35 user nova-compute[74934]: INFO nova.compute.claims [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Claim successful on node user
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:56:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.policy [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdbd678512a7438bac9bc337a0d94ecf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0de5bebd7613411cb782d31ed1884da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Cannot resize image /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Ensure instance console log exists: /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:56:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Creating image(s)
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Successfully created port: 7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk 1073741824" returned: 0 in 0.083s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:35 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.219s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Successfully created port: 7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.020s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-130dc6d6-eddc-43ea-822c-fdd4654161ee req-8c32ffb0-9fb5-44fd-b48f-e3f99d804cac service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-130dc6d6-eddc-43ea-822c-fdd4654161ee req-8c32ffb0-9fb5-44fd-b48f-e3f99d804cac service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-130dc6d6-eddc-43ea-822c-fdd4654161ee req-8c32ffb0-9fb5-44fd-b48f-e3f99d804cac service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-130dc6d6-eddc-43ea-822c-fdd4654161ee req-8c32ffb0-9fb5-44fd-b48f-e3f99d804cac service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-130dc6d6-eddc-43ea-822c-fdd4654161ee req-8c32ffb0-9fb5-44fd-b48f-e3f99d804cac service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:36 user nova-compute[74934]: WARNING nova.compute.manager [req-130dc6d6-eddc-43ea-822c-fdd4654161ee req-8c32ffb0-9fb5-44fd-b48f-e3f99d804cac service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state active and task_state rescuing.
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Successfully updated port: 7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:56:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "refresh_cache-2f7bf511-949f-4273-b8c6-1fe3512cae48" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquired lock "refresh_cache-2f7bf511-949f-4273-b8c6-1fe3512cae48" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received event network-changed-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Refreshing instance network info cache due to event network-changed-7a97d7d1-7747-4068-b89a-40c2d104600d. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] Acquiring lock "refresh_cache-2f7bf511-949f-4273-b8c6-1fe3512cae48" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Cannot resize image /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Ensure instance console log exists: /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.policy [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08d75edb533b4dfca6e9785c439df050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5862e932d40a68f17b4e8bb77ef77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:56:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Creating image(s)
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.207s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk 1073741824" returned: 0 in 0.085s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Updating instance_info_cache with network_info: [{"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Successfully created port: 92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Releasing lock "refresh_cache-2f7bf511-949f-4273-b8c6-1fe3512cae48" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Instance network_info: |[{"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] Acquired lock "refresh_cache-2f7bf511-949f-4273-b8c6-1fe3512cae48" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Refreshing network info cache for port 7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Start _get_guest_xml network_info=[{"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:56:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-285731068',display_name='tempest-VolumesActionsTest-instance-285731068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-285731068',id=28,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8be92c125fd34bef8e55fa83ef3d5f61',ramdisk_id='',reservation_id='r-q0he0mjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1012691079',owner_user_name='tempest-VolumesActionsTest-1012691079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:34Z,user_data=None,user_id='e87a983281b3497781f13b9e3aafa55a',uuid=2f7bf511-949f-4273-b8c6-1fe3512cae48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converting VIF {"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f7bf511-949f-4273-b8c6-1fe3512cae48 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:56:37 user nova-compute[74934]:   <uuid>2f7bf511-949f-4273-b8c6-1fe3512cae48</uuid>
Nov 19 14:56:37 user nova-compute[74934]:   <name>instance-0000001c</name>
Nov 19 14:56:37 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:56:37 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:56:37 user nova-compute[74934]:   <metadata>
Nov 19 14:56:37 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:56:37 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:name>tempest-VolumesActionsTest-instance-285731068</nova:name>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:56:37</nova:creationTime>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:56:37 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:56:37 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:owner>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:user uuid="e87a983281b3497781f13b9e3aafa55a">tempest-VolumesActionsTest-1012691079-project-member</nova:user>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:project uuid="8be92c125fd34bef8e55fa83ef3d5f61">tempest-VolumesActionsTest-1012691079</nova:project>
Nov 19 14:56:37 user nova-compute[74934]:       </nova:owner>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:ports>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:port uuid="7a97d7d1-7747-4068-b89a-40c2d104600d">
Nov 19 14:56:37 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:56:37 user nova-compute[74934]:         </nova:port>
Nov 19 14:56:37 user nova-compute[74934]:       </nova:ports>
Nov 19 14:56:37 user nova-compute[74934]:     </nova:instance>
Nov 19 14:56:37 user nova-compute[74934]:   </metadata>
Nov 19 14:56:37 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:56:37 user nova-compute[74934]:     <system>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="serial">2f7bf511-949f-4273-b8c6-1fe3512cae48</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="uuid">2f7bf511-949f-4273-b8c6-1fe3512cae48</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:56:37 user nova-compute[74934]:     </system>
Nov 19 14:56:37 user nova-compute[74934]:   </sysinfo>
Nov 19 14:56:37 user nova-compute[74934]:   <os>
Nov 19 14:56:37 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:56:37 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:56:37 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:56:37 user nova-compute[74934]:   </os>
Nov 19 14:56:37 user nova-compute[74934]:   <features>
Nov 19 14:56:37 user nova-compute[74934]:     <acpi/>
Nov 19 14:56:37 user nova-compute[74934]:     <apic/>
Nov 19 14:56:37 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:56:37 user nova-compute[74934]:   </features>
Nov 19 14:56:37 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:56:37 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:56:37 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:56:37 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:56:37 user nova-compute[74934]:   </clock>
Nov 19 14:56:37 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:56:37 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:56:37 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:56:37 user nova-compute[74934]:   </cpu>
Nov 19 14:56:37 user nova-compute[74934]:   <devices>
Nov 19 14:56:37 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:56:37 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:56:37 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk"/>
Nov 19 14:56:37 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:56:37 user nova-compute[74934]:     </disk>
Nov 19 14:56:37 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:56:37 user nova-compute[74934]:       <mac address="fa:16:3e:8a:b3:3c"/>
Nov 19 14:56:37 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:37 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:56:37 user nova-compute[74934]:       <target dev="tap7a97d7d1-77"/>
Nov 19 14:56:37 user nova-compute[74934]:     </interface>
Nov 19 14:56:37 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:56:37 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/console.log" append="off"/>
Nov 19 14:56:37 user nova-compute[74934]:     </serial>
Nov 19 14:56:37 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:56:37 user nova-compute[74934]:     <video>
Nov 19 14:56:37 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:37 user nova-compute[74934]:     </video>
Nov 19 14:56:37 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:56:37 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:56:37 user nova-compute[74934]:     </rng>
Nov 19 14:56:37 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:56:37 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:56:37 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:56:37 user nova-compute[74934]:     </memballoon>
Nov 19 14:56:37 user nova-compute[74934]:   </devices>
Nov 19 14:56:37 user nova-compute[74934]: </domain>
Nov 19 14:56:37 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-285731068',display_name='tempest-VolumesActionsTest-instance-285731068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-285731068',id=28,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8be92c125fd34bef8e55fa83ef3d5f61',ramdisk_id='',reservation_id='r-q0he0mjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1012691079',owner_user_name='tempest-VolumesActionsTest-1012691079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:34Z,user_data=None,user_id='e87a983281b3497781f13b9e3aafa55a',uuid=2f7bf511-949f-4273-b8c6-1fe3512cae48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converting VIF {"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG os_vif [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd0777f3-3020-5c06-83ed-9c3a3c942939', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Successfully updated port: 7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a97d7d1-77, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a97d7d1-77, col_values=(('qos', UUID('ce41a182-dfd4-4f1e-913a-851a1422bbac')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a97d7d1-77, col_values=(('external_ids', {'iface-id': '7a97d7d1-7747-4068-b89a-40c2d104600d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:b3:3c', 'vm-uuid': '2f7bf511-949f-4273-b8c6-1fe3512cae48'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: INFO os_vif [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77')
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing instance network info cache due to event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] No VIF found with MAC fa:16:3e:8a:b3:3c, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Cannot resize image /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Ensure instance console log exists: /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Successfully updated port: 92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-0cfbf310-4580-4054-87dd-613f1e8ad7fa" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-0cfbf310-4580-4054-87dd-613f1e8ad7fa" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Updated VIF entry in instance network info cache for port 7a97d7d1-7747-4068-b89a-40c2d104600d. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Updating instance_info_cache with network_info: [{"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-caece278-ae65-4edc-9a0a-f7731bc3904b req-2af89c6e-fb43-4a72-b960-a498100c4b76 service nova] Releasing lock "refresh_cache-2f7bf511-949f-4273-b8c6-1fe3512cae48" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance network_info: |[{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Start _get_guest_xml network_info=[{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:56:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-521385301',display_name='tempest-ServerRescueNegativeTestJSON-server-521385301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-521385301',id=29,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU25u6vlQLM4pT/EdPPLpw7XpBuyzy9Dan9CS0/h4hAKePRDZULoDhSjuLEkrX/OP3672WGh+4bUlDJsQS6bbquprDIJ6TvTyIKhMuKUoRqIQLytBgS3VE83Q5EPBB/sA==',key_name='tempest-keypair-1812534498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-gdyhmcqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=78b81733-fd30-4009-9945-0c34c3b88fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'pci_devices' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:56:37 user nova-compute[74934]:   <uuid>78b81733-fd30-4009-9945-0c34c3b88fbe</uuid>
Nov 19 14:56:37 user nova-compute[74934]:   <name>instance-0000001d</name>
Nov 19 14:56:37 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:56:37 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:56:37 user nova-compute[74934]:   <metadata>
Nov 19 14:56:37 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:56:37 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-521385301</nova:name>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:56:37</nova:creationTime>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:56:37 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:56:37 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:owner>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:user uuid="cdbd678512a7438bac9bc337a0d94ecf">tempest-ServerRescueNegativeTestJSON-1330458851-project-member</nova:user>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:project uuid="0de5bebd7613411cb782d31ed1884da8">tempest-ServerRescueNegativeTestJSON-1330458851</nova:project>
Nov 19 14:56:37 user nova-compute[74934]:       </nova:owner>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:56:37 user nova-compute[74934]:       <nova:ports>
Nov 19 14:56:37 user nova-compute[74934]:         <nova:port uuid="7a10bd8e-6da2-4738-8c7d-074dfeee726f">
Nov 19 14:56:37 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 14:56:37 user nova-compute[74934]:         </nova:port>
Nov 19 14:56:37 user nova-compute[74934]:       </nova:ports>
Nov 19 14:56:37 user nova-compute[74934]:     </nova:instance>
Nov 19 14:56:37 user nova-compute[74934]:   </metadata>
Nov 19 14:56:37 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:56:37 user nova-compute[74934]:     <system>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="serial">78b81733-fd30-4009-9945-0c34c3b88fbe</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="uuid">78b81733-fd30-4009-9945-0c34c3b88fbe</entry>
Nov 19 14:56:37 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:56:37 user nova-compute[74934]:     </system>
Nov 19 14:56:37 user nova-compute[74934]:   </sysinfo>
Nov 19 14:56:37 user nova-compute[74934]:   <os>
Nov 19 14:56:37 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:56:37 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:56:37 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:56:37 user nova-compute[74934]:   </os>
Nov 19 14:56:37 user nova-compute[74934]:   <features>
Nov 19 14:56:37 user nova-compute[74934]:     <acpi/>
Nov 19 14:56:37 user nova-compute[74934]:     <apic/>
Nov 19 14:56:37 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:56:37 user nova-compute[74934]:   </features>
Nov 19 14:56:37 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:56:37 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:56:37 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:56:37 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:56:37 user nova-compute[74934]:   </clock>
Nov 19 14:56:37 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:56:37 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:56:37 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:56:37 user nova-compute[74934]:   </cpu>
Nov 19 14:56:37 user nova-compute[74934]:   <devices>
Nov 19 14:56:37 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:56:37 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:56:37 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk"/>
Nov 19 14:56:37 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:56:37 user nova-compute[74934]:     </disk>
Nov 19 14:56:37 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:56:37 user nova-compute[74934]:       <mac address="fa:16:3e:bd:0a:7a"/>
Nov 19 14:56:37 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:37 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:56:37 user nova-compute[74934]:       <target dev="tap7a10bd8e-6d"/>
Nov 19 14:56:37 user nova-compute[74934]:     </interface>
Nov 19 14:56:37 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:56:37 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/console.log" append="off"/>
Nov 19 14:56:37 user nova-compute[74934]:     </serial>
Nov 19 14:56:37 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:56:37 user nova-compute[74934]:     <video>
Nov 19 14:56:37 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:37 user nova-compute[74934]:     </video>
Nov 19 14:56:37 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:56:37 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:56:37 user nova-compute[74934]:     </rng>
Nov 19 14:56:37 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:56:37 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:56:37 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:56:37 user nova-compute[74934]:     </memballoon>
Nov 19 14:56:37 user nova-compute[74934]:   </devices>
Nov 19 14:56:37 user nova-compute[74934]: </domain>
Nov 19 14:56:37 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-521385301',display_name='tempest-ServerRescueNegativeTestJSON-server-521385301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-521385301',id=29,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU25u6vlQLM4pT/EdPPLpw7XpBuyzy9Dan9CS0/h4hAKePRDZULoDhSjuLEkrX/OP3672WGh+4bUlDJsQS6bbquprDIJ6TvTyIKhMuKUoRqIQLytBgS3VE83Q5EPBB/sA==',key_name='tempest-keypair-1812534498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-gdyhmcqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=78b81733-fd30-4009-9945-0c34c3b88fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG os_vif [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b281348-6d37-5208-935f-7c0a59bebba8', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a10bd8e-6d, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a10bd8e-6d, col_values=(('qos', UUID('11969015-fd2c-41c6-b148-f4071b0710c9')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a10bd8e-6d, col_values=(('external_ids', {'iface-id': '7a10bd8e-6da2-4738-8c7d-074dfeee726f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:0a:7a', 'vm-uuid': '78b81733-fd30-4009-9945-0c34c3b88fbe'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:37 user nova-compute[74934]: INFO os_vif [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d')
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:bd:0a:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Updating instance_info_cache with network_info: [{"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-0cfbf310-4580-4054-87dd-613f1e8ad7fa" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Instance network_info: |[{"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Start _get_guest_xml network_info=[{"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:56:38 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:38 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-667716880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-667716880',id=30,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-aocamzbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:36Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=0cfbf310-4580-4054-87dd-613f1e8ad7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cfbf310-4580-4054-87dd-613f1e8ad7fa {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:56:38 user nova-compute[74934]:   <uuid>0cfbf310-4580-4054-87dd-613f1e8ad7fa</uuid>
Nov 19 14:56:38 user nova-compute[74934]:   <name>instance-0000001e</name>
Nov 19 14:56:38 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:56:38 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:56:38 user nova-compute[74934]:   <metadata>
Nov 19 14:56:38 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:56:38 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:56:38 user nova-compute[74934]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-667716880</nova:name>
Nov 19 14:56:38 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:56:38</nova:creationTime>
Nov 19 14:56:38 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:56:38 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:56:38 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:56:38 user nova-compute[74934]:       <nova:owner>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:user uuid="08d75edb533b4dfca6e9785c439df050">tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member</nova:user>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:project uuid="0da5862e932d40a68f17b4e8bb77ef77">tempest-ServerBootFromVolumeStableRescueTest-1047020547</nova:project>
Nov 19 14:56:38 user nova-compute[74934]:       </nova:owner>
Nov 19 14:56:38 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:56:38 user nova-compute[74934]:       <nova:ports>
Nov 19 14:56:38 user nova-compute[74934]:         <nova:port uuid="92d364ed-e618-47c7-a0b9-1121c50bd8f8">
Nov 19 14:56:38 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 19 14:56:38 user nova-compute[74934]:         </nova:port>
Nov 19 14:56:38 user nova-compute[74934]:       </nova:ports>
Nov 19 14:56:38 user nova-compute[74934]:     </nova:instance>
Nov 19 14:56:38 user nova-compute[74934]:   </metadata>
Nov 19 14:56:38 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:56:38 user nova-compute[74934]:     <system>
Nov 19 14:56:38 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:56:38 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:56:38 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:56:38 user nova-compute[74934]:       <entry name="serial">0cfbf310-4580-4054-87dd-613f1e8ad7fa</entry>
Nov 19 14:56:38 user nova-compute[74934]:       <entry name="uuid">0cfbf310-4580-4054-87dd-613f1e8ad7fa</entry>
Nov 19 14:56:38 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:56:38 user nova-compute[74934]:     </system>
Nov 19 14:56:38 user nova-compute[74934]:   </sysinfo>
Nov 19 14:56:38 user nova-compute[74934]:   <os>
Nov 19 14:56:38 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:56:38 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:56:38 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:56:38 user nova-compute[74934]:   </os>
Nov 19 14:56:38 user nova-compute[74934]:   <features>
Nov 19 14:56:38 user nova-compute[74934]:     <acpi/>
Nov 19 14:56:38 user nova-compute[74934]:     <apic/>
Nov 19 14:56:38 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:56:38 user nova-compute[74934]:   </features>
Nov 19 14:56:38 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:56:38 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:56:38 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:56:38 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:56:38 user nova-compute[74934]:   </clock>
Nov 19 14:56:38 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:56:38 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:56:38 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:56:38 user nova-compute[74934]:   </cpu>
Nov 19 14:56:38 user nova-compute[74934]:   <devices>
Nov 19 14:56:38 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:56:38 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:56:38 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk"/>
Nov 19 14:56:38 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:56:38 user nova-compute[74934]:     </disk>
Nov 19 14:56:38 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:56:38 user nova-compute[74934]:       <mac address="fa:16:3e:a3:3a:79"/>
Nov 19 14:56:38 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:38 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:56:38 user nova-compute[74934]:       <target dev="tap92d364ed-e6"/>
Nov 19 14:56:38 user nova-compute[74934]:     </interface>
Nov 19 14:56:38 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:56:38 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/console.log" append="off"/>
Nov 19 14:56:38 user nova-compute[74934]:     </serial>
Nov 19 14:56:38 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:56:38 user nova-compute[74934]:     <video>
Nov 19 14:56:38 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:38 user nova-compute[74934]:     </video>
Nov 19 14:56:38 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:56:38 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:56:38 user nova-compute[74934]:     </rng>
Nov 19 14:56:38 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:56:38 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:56:38 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:56:38 user nova-compute[74934]:     </memballoon>
Nov 19 14:56:38 user nova-compute[74934]:   </devices>
Nov 19 14:56:38 user nova-compute[74934]: </domain>
Nov 19 14:56:38 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-667716880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-667716880',id=30,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-aocamzbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:36Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=0cfbf310-4580-4054-87dd-613f1e8ad7fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_vif [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83e979a5-79cb-5d24-b15c-889304dcfa11', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92d364ed-e6, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92d364ed-e6, col_values=(('qos', UUID('fd172be5-a348-4b58-88a5-fdae813cbc7b')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92d364ed-e6, col_values=(('external_ids', {'iface-id': '92d364ed-e618-47c7-a0b9-1121c50bd8f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:3a:79', 'vm-uuid': '0cfbf310-4580-4054-87dd-613f1e8ad7fa'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:38 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fee595d0-5f2c-4e12-8806-b28e02675c74 is timed out.
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully detached device vdb from instance fee595d0-5f2c-4e12-8806-b28e02675c74 from the live domain config.
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECjrNymB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:38 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-2625f96a-1375-4a5e-b003-2f494cca65a1 req-00ce9900-39bc-470d-a326-aa5c27e6fab9 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2625f96a-1375-4a5e-b003-2f494cca65a1 req-00ce9900-39bc-470d-a326-aa5c27e6fab9 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2625f96a-1375-4a5e-b003-2f494cca65a1 req-00ce9900-39bc-470d-a326-aa5c27e6fab9 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2625f96a-1375-4a5e-b003-2f494cca65a1 req-00ce9900-39bc-470d-a326-aa5c27e6fab9 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-2625f96a-1375-4a5e-b003-2f494cca65a1 req-00ce9900-39bc-470d-a326-aa5c27e6fab9 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:38 user nova-compute[74934]: WARNING nova.compute.manager [req-2625f96a-1375-4a5e-b003-2f494cca65a1 req-00ce9900-39bc-470d-a326-aa5c27e6fab9 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state active and task_state rescuing.
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c2ffaaf8-8b9c-48f3-bd3a-8472d5d92e49 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:38 user nova-compute[74934]: INFO os_vif [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6')
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb692ab6-d6a9-4312-a87d-6705957932c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:56:38 user nova-compute[74934]: No targets found.
Nov 19 14:56:38 user nova-compute[74934]: iSNS:
Nov 19 14:56:38 user nova-compute[74934]: No targets found.
Nov 19 14:56:38 user nova-compute[74934]: STATIC:
Nov 19 14:56:38 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:56:38 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:38 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:38 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:56:38 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:38 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:38 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:56:38 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:38 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:38 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5
Nov 19 14:56:38 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:38 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:38 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa
Nov 19 14:56:38 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:38 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:38 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:56:38 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:38 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:38 user nova-compute[74934]: FIRMWARE:
Nov 19 14:56:38 user nova-compute[74934]: No targets found.
Nov 19 14:56:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:56:38 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:56:38 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8170ad-1945-4f4d-a8ad-8c98c7a94971]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5537fe8-4176-4cd1-aba5-48e5abb2b94a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:38 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4447a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No VIF found with MAC fa:16:3e:a3:3a:79, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bcbeb8-d141-4e70-a8f5-f439ac682fe5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2311e517-5a9a-444b-b590-64787fee22d9]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-changed-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Refreshing instance network info cache due to event network-changed-92d364ed-e618-47c7-a0b9-1121c50bd8f8. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] Acquiring lock "refresh_cache-0cfbf310-4580-4054-87dd-613f1e8ad7fa" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] Acquired lock "refresh_cache-0cfbf310-4580-4054-87dd-613f1e8ad7fa" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Refreshing network info cache for port 92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ba308-dfee-4d9d-aef5-acb91019c5d4]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[02107004-2f84-4aa3-b697-cb3e59b7a7e7]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8e5be8-fafe-4d06-80ed-8d4abfccbbd1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a0cce8-4ddf-4ab0-be62-f9590e5907e8]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260]
Nov 19 14:56:38 user nova-compute[74934]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa, portal: 172.16.0.220,3260] successful.
Nov 19 14:56:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2511dc16-2c88-4638-ba43-e0a3636726fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f48a72-0a65-4c3c-b4d9-90edbc86d339]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== disconnect_volume: return (337ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updated VIF entry in instance network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-610b4cda-6d73-47df-aba1-b2cbf1a3ac0a req-ef4dfdb8-e23c-4c51-a20b-647933baa07a service nova] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Updated VIF entry in instance network info cache for port 92d364ed-e618-47c7-a0b9-1121c50bd8f8. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Updating instance_info_cache with network_info: [{"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-318c2afd-a4ea-4224-a466-ab0e3ebc5912 req-008e7642-b220-4c76-bf14-0dc9cd3e7b0d service nova] Releasing lock "refresh_cache-0cfbf310-4580-4054-87dd-613f1e8ad7fa" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'flavor' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2e1f8e6e-fdd0-49cc-9acb-65937b4ce350 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:39 user nova-compute[74934]: INFO nova.compute.manager [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Detaching volume 9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:56:39 user nova-compute[74934]: INFO nova.virt.block_device [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Attempting to driver detach volume 9ee7fafa-fc91-4208-b2f7-67f45bcb3717 from mountpoint /dev/vdb
Nov 19 14:56:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Attempting to detach device vdb from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:56:39 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:39 user nova-compute[74934]:   <source dev="/dev/sde"/>
Nov 19 14:56:39 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:56:39 user nova-compute[74934]:   <serial>9ee7fafa-fc91-4208-b2f7-67f45bcb3717</serial>
Nov 19 14:56:39 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:56:39 user nova-compute[74934]: </disk>
Nov 19 14:56:39 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:56:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully detached device vdb from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b from the persistent domain config.
Nov 19 14:56:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:56:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:56:39 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:39 user nova-compute[74934]:   <source dev="/dev/sde"/>
Nov 19 14:56:39 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:56:39 user nova-compute[74934]:   <serial>9ee7fafa-fc91-4208-b2f7-67f45bcb3717</serial>
Nov 19 14:56:39 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:56:39 user nova-compute[74934]: </disk>
Nov 19 14:56:39 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:56:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:56:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-d230ed6c-c934-4599-9106-5612fd8405ff req-91c9eff0-0040-46d3-b9d1-8671abf26696 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d230ed6c-c934-4599-9106-5612fd8405ff req-91c9eff0-0040-46d3-b9d1-8671abf26696 service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d230ed6c-c934-4599-9106-5612fd8405ff req-91c9eff0-0040-46d3-b9d1-8671abf26696 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d230ed6c-c934-4599-9106-5612fd8405ff req-91c9eff0-0040-46d3-b9d1-8671abf26696 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-d230ed6c-c934-4599-9106-5612fd8405ff req-91c9eff0-0040-46d3-b9d1-8671abf26696 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:41 user nova-compute[74934]: WARNING nova.compute.manager [req-d230ed6c-c934-4599-9106-5612fd8405ff req-91c9eff0-0040-46d3-b9d1-8671abf26696 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state building and task_state spawning.
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-142cfcfe-4898-413e-9d50-04c8185c5101 req-4da06082-2a86-4b77-aadf-4c146dbcfb08 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received event network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-142cfcfe-4898-413e-9d50-04c8185c5101 req-4da06082-2a86-4b77-aadf-4c146dbcfb08 service nova] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-142cfcfe-4898-413e-9d50-04c8185c5101 req-4da06082-2a86-4b77-aadf-4c146dbcfb08 service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-142cfcfe-4898-413e-9d50-04c8185c5101 req-4da06082-2a86-4b77-aadf-4c146dbcfb08 service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-142cfcfe-4898-413e-9d50-04c8185c5101 req-4da06082-2a86-4b77-aadf-4c146dbcfb08 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] No waiting events found dispatching network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:41 user nova-compute[74934]: WARNING nova.compute.manager [req-142cfcfe-4898-413e-9d50-04c8185c5101 req-4da06082-2a86-4b77-aadf-4c146dbcfb08 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received unexpected event network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d for instance with vm_state building and task_state spawning.
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-be59a7fa-c57c-413d-af80-f79696d534e8 req-0eefeacb-b3b6-407f-8d80-a8e2185902f3 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-be59a7fa-c57c-413d-af80-f79696d534e8 req-0eefeacb-b3b6-407f-8d80-a8e2185902f3 service nova] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-be59a7fa-c57c-413d-af80-f79696d534e8 req-0eefeacb-b3b6-407f-8d80-a8e2185902f3 service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-be59a7fa-c57c-413d-af80-f79696d534e8 req-0eefeacb-b3b6-407f-8d80-a8e2185902f3 service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-be59a7fa-c57c-413d-af80-f79696d534e8 req-0eefeacb-b3b6-407f-8d80-a8e2185902f3 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] No waiting events found dispatching network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:42 user nova-compute[74934]: WARNING nova.compute.manager [req-be59a7fa-c57c-413d-af80-f79696d534e8 req-0eefeacb-b3b6-407f-8d80-a8e2185902f3 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received unexpected event network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 for instance with vm_state building and task_state spawning.
Nov 19 14:56:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-331b9c51-3e08-4a86-846a-7b7e0fc2cbc5 req-3be85ab5-a97b-43ae-8aa7-de3bf85e1fcb service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-331b9c51-3e08-4a86-846a-7b7e0fc2cbc5 req-3be85ab5-a97b-43ae-8aa7-de3bf85e1fcb service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-331b9c51-3e08-4a86-846a-7b7e0fc2cbc5 req-3be85ab5-a97b-43ae-8aa7-de3bf85e1fcb service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-331b9c51-3e08-4a86-846a-7b7e0fc2cbc5 req-3be85ab5-a97b-43ae-8aa7-de3bf85e1fcb service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-331b9c51-3e08-4a86-846a-7b7e0fc2cbc5 req-3be85ab5-a97b-43ae-8aa7-de3bf85e1fcb service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:43 user nova-compute[74934]: WARNING nova.compute.manager [req-331b9c51-3e08-4a86-846a-7b7e0fc2cbc5 req-3be85ab5-a97b-43ae-8aa7-de3bf85e1fcb service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state building and task_state spawning.
Nov 19 14:56:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-91a6c910-ce86-49ff-9b13-8aa6605b9b27 req-01bba88f-8439-43c7-8497-cd525894c59d service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received event network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-91a6c910-ce86-49ff-9b13-8aa6605b9b27 req-01bba88f-8439-43c7-8497-cd525894c59d service nova] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-91a6c910-ce86-49ff-9b13-8aa6605b9b27 req-01bba88f-8439-43c7-8497-cd525894c59d service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-91a6c910-ce86-49ff-9b13-8aa6605b9b27 req-01bba88f-8439-43c7-8497-cd525894c59d service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-91a6c910-ce86-49ff-9b13-8aa6605b9b27 req-01bba88f-8439-43c7-8497-cd525894c59d service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] No waiting events found dispatching network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:43 user nova-compute[74934]: WARNING nova.compute.manager [req-91a6c910-ce86-49ff-9b13-8aa6605b9b27 req-01bba88f-8439-43c7-8497-cd525894c59d service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received unexpected event network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d for instance with vm_state building and task_state spawning.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-b9bcae54-b82f-4c84-a691-5287ee2e5c84 req-0804e98f-d8f1-47b0-8b54-656b7327bd0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b9bcae54-b82f-4c84-a691-5287ee2e5c84 req-0804e98f-d8f1-47b0-8b54-656b7327bd0d service nova] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b9bcae54-b82f-4c84-a691-5287ee2e5c84 req-0804e98f-d8f1-47b0-8b54-656b7327bd0d service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b9bcae54-b82f-4c84-a691-5287ee2e5c84 req-0804e98f-d8f1-47b0-8b54-656b7327bd0d service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-b9bcae54-b82f-4c84-a691-5287ee2e5c84 req-0804e98f-d8f1-47b0-8b54-656b7327bd0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] No waiting events found dispatching network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:56:44 user nova-compute[74934]: WARNING nova.compute.manager [req-b9bcae54-b82f-4c84-a691-5287ee2e5c84 req-0804e98f-d8f1-47b0-8b54-656b7327bd0d service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received unexpected event network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 for instance with vm_state building and task_state spawning.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Instance spawned successfully.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance spawned successfully.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Took 10.04 seconds to spawn the instance on the hypervisor.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Took 9.09 seconds to spawn the instance on the hypervisor.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Instance spawned successfully.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.compute.manager [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Took 11.09 seconds to build instance.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8a8aed3e-0421-4cce-bf3f-d5d0f944f8c5 tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.198s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.compute.manager [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Took 10.46 seconds to build instance.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a4194edc-6eeb-465c-897d-2cb82b71f776 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.568s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:56:44 user nova-compute[74934]: INFO nova.compute.manager [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Took 9.74 seconds to build instance.
Nov 19 14:56:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f12fd62d-18c5-4693-b96f-b8875e1bd266 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.024s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:51 user nova-compute[74934]: INFO nova.compute.manager [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Unshelving
Nov 19 14:56:51 user nova-compute[74934]: INFO nova.virt.block_device [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Booting with volume 544e5d76-baf5-48d1-ac1c-07147b08ef06 at /dev/vda
Nov 19 14:56:51 user nova-compute[74934]: DEBUG os_brick.utils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8753124c-eeb7-4763-bd24-7f930715fe7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c3e79-78b1-4b1d-a760-339b61bdca61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad13484-7924-4242-8e91-538b42eca3f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c34643-7c61-46f9-ae5b-1bdcf4c28c07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:56:51 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:56:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaede92d-baed-4afd-8938-f2b6cd1f37cd]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG os_brick.utils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:51 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating existing volume attachment record: 828f5471-cf3a-4e90-b2b2-a75fbabe444c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:56:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:53 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquired lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG nova.network.neutron [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'info_cache' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.network.neutron [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Releasing lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:56:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance destroyed successfully.
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'resources' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:55:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e5537c-70, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4b4edff-465e-4a14-bd56-a032717ded57) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:55 user nova-compute[74934]: INFO os_vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70')
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:55 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ca03f1-5bb6-4040-9894-382e2e83fe64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:56:55 user nova-compute[74934]: No targets found.
Nov 19 14:56:55 user nova-compute[74934]: iSNS:
Nov 19 14:56:55 user nova-compute[74934]: No targets found.
Nov 19 14:56:55 user nova-compute[74934]: STATIC:
Nov 19 14:56:55 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:56:55 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:55 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:55 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:56:55 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:55 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:55 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:56:55 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:55 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:55 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5
Nov 19 14:56:55 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:55 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:55 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:56:55 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:56:55 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:56:55 user nova-compute[74934]: FIRMWARE:
Nov 19 14:56:55 user nova-compute[74934]: No targets found.
Nov 19 14:56:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:56:55 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:56:55 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c8f80d-5378-403f-ad80-50d00a68f315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ada49c0-e8b6-48fd-bd40-1176c102033c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:55 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c45bf640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b'): ({'sdf'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Removing single pathed devices sdf {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec939d-ff7c-4d1f-b2fa-bd7639413be5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7143100-bbf1-4f9e-b6b2-837456441c4c]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flushing IO for device /dev/sdf {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dbbb78-81b1-4998-8412-097285985130]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb899be-018f-4497-8352-e37ddbe559e7]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a360d7-a2e6-43e9-b292-b3b6a0d94ee0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b872f9-2afd-4b88-b099-0822f2257cb7]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]
Nov 19 14:56:55 user nova-compute[74934]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.
Nov 19 14:56:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6fcb5e-4e40-475b-a9d5-90bde9e4b4b9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== disconnect_volume: return (402ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start _get_guest_xml network_info=[{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'aaeb49f6-7821-402c-9b9a-58fd790c6201', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '32eaf46a-1013-456e-9c2c-9f8805a53e20', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'serial': 'ed26e3c0-5aab-4ea1-aa51-ad9e9475074b'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'numa_topology' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:55 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:55 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:56:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:56:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:56:56 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:56 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:56:56 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9e55ba-54ff-4274-9a18-4fc6396d2b1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:56:56 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5efd4c-c6cd-4af4-a1a9-a773a21a85ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b] added
Nov 19 14:56:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c38b20-ad64-4fb3-a0af-7cdf7551139c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa77badc-edad-4cc5-8e23-7d3e31636107]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPiLAcBj {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPiLAcBj" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4239572-5d73-465e-9719-0c75ecb0369f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPiLAcBj'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef5ee5c-fd01-42dc-8631-4473857130e7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df798cc7-f63f-4078-8113-42df1df314f1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4df86c-c248-4995-b599-713589a077f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]
Nov 19 14:56:56 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.
Nov 19 14:56:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid '32eaf46a-1013-456e-9c2c-9f8805a53e20' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid '32eaf46a-1013-456e-9c2c-9f8805a53e20' (instance-00000014)
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3cee2-27ff-4c77-8085-52700d0d7f69]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7ed081-bed0-4e74-af13-7ff6af006dd6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:56:56 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:56:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4dbcc7-1777-406c-ab2a-e7ed1f2ed9fa]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26233396162656631', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233396162656631', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:55:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'pci_devices' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:56:57 user nova-compute[74934]:   <uuid>32eaf46a-1013-456e-9c2c-9f8805a53e20</uuid>
Nov 19 14:56:57 user nova-compute[74934]:   <name>instance-00000014</name>
Nov 19 14:56:57 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:56:57 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:56:57 user nova-compute[74934]:   <metadata>
Nov 19 14:56:57 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:56:57 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:56:57 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeTestJSON-server-2078832358</nova:name>
Nov 19 14:56:57 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:56:55</nova:creationTime>
Nov 19 14:56:57 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:56:57 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:56:57 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:56:57 user nova-compute[74934]:       <nova:owner>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:user uuid="eda5707b8cd7412098e9d0b3e4bdc536">tempest-AttachVolumeTestJSON-980904147-project-member</nova:user>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:project uuid="cd008f473dc744a9bc9f1ebc2f4cb95d">tempest-AttachVolumeTestJSON-980904147</nova:project>
Nov 19 14:56:57 user nova-compute[74934]:       </nova:owner>
Nov 19 14:56:57 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:56:57 user nova-compute[74934]:       <nova:ports>
Nov 19 14:56:57 user nova-compute[74934]:         <nova:port uuid="f4e5537c-702b-445b-a266-44da04a6747d">
Nov 19 14:56:57 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 14:56:57 user nova-compute[74934]:         </nova:port>
Nov 19 14:56:57 user nova-compute[74934]:       </nova:ports>
Nov 19 14:56:57 user nova-compute[74934]:     </nova:instance>
Nov 19 14:56:57 user nova-compute[74934]:   </metadata>
Nov 19 14:56:57 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:56:57 user nova-compute[74934]:     <system>
Nov 19 14:56:57 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:56:57 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:56:57 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:56:57 user nova-compute[74934]:       <entry name="serial">32eaf46a-1013-456e-9c2c-9f8805a53e20</entry>
Nov 19 14:56:57 user nova-compute[74934]:       <entry name="uuid">32eaf46a-1013-456e-9c2c-9f8805a53e20</entry>
Nov 19 14:56:57 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:56:57 user nova-compute[74934]:     </system>
Nov 19 14:56:57 user nova-compute[74934]:   </sysinfo>
Nov 19 14:56:57 user nova-compute[74934]:   <os>
Nov 19 14:56:57 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:56:57 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:56:57 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:56:57 user nova-compute[74934]:   </os>
Nov 19 14:56:57 user nova-compute[74934]:   <features>
Nov 19 14:56:57 user nova-compute[74934]:     <acpi/>
Nov 19 14:56:57 user nova-compute[74934]:     <apic/>
Nov 19 14:56:57 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:56:57 user nova-compute[74934]:   </features>
Nov 19 14:56:57 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:56:57 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:56:57 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:56:57 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:56:57 user nova-compute[74934]:   </clock>
Nov 19 14:56:57 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:56:57 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:56:57 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:56:57 user nova-compute[74934]:   </cpu>
Nov 19 14:56:57 user nova-compute[74934]:   <devices>
Nov 19 14:56:57 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:56:57 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:56:57 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk"/>
Nov 19 14:56:57 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:56:57 user nova-compute[74934]:     </disk>
Nov 19 14:56:57 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:56:57 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:56:57 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 14:56:57 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:56:57 user nova-compute[74934]:       <serial>ed26e3c0-5aab-4ea1-aa51-ad9e9475074b</serial>
Nov 19 14:56:57 user nova-compute[74934]:     </disk>
Nov 19 14:56:57 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:56:57 user nova-compute[74934]:       <mac address="fa:16:3e:81:ed:9b"/>
Nov 19 14:56:57 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:57 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:56:57 user nova-compute[74934]:       <target dev="tapf4e5537c-70"/>
Nov 19 14:56:57 user nova-compute[74934]:     </interface>
Nov 19 14:56:57 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:56:57 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/console.log" append="off"/>
Nov 19 14:56:57 user nova-compute[74934]:     </serial>
Nov 19 14:56:57 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:56:57 user nova-compute[74934]:     <video>
Nov 19 14:56:57 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:56:57 user nova-compute[74934]:     </video>
Nov 19 14:56:57 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:56:57 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:56:57 user nova-compute[74934]:     </rng>
Nov 19 14:56:57 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:56:57 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:56:57 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:56:57 user nova-compute[74934]:     </memballoon>
Nov 19 14:56:57 user nova-compute[74934]:   </devices>
Nov 19 14:56:57 user nova-compute[74934]: </domain>
Nov 19 14:56:57 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'pci_requests' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'numa_topology' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:56:57 user nova-compute[74934]: INFO nova.compute.claims [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Claim successful on node user
Nov 19 14:56:57 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Cannot resize image /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.objects.instance [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'migration_context' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.objects.base [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:55:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG os_vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f63473bc-7bae-5ec8-8a25-927e6e4e81e0', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e5537c-70, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4e5537c-70, col_values=(('qos', UUID('6360abd8-62a5-41de-bd65-9bf09a0d9d9b')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4e5537c-70, col_values=(('external_ids', {'iface-id': 'f4e5537c-702b-445b-a266-44da04a6747d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ed:9b', 'vm-uuid': '32eaf46a-1013-456e-9c2c-9f8805a53e20'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:58 user nova-compute[74934]: INFO os_vif [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70')
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.962s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:58 user nova-compute[74934]: INFO nova.network.neutron [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG nova.network.neutron [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing instance network info cache due to event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:56:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "417da1fc-af51-4c8b-8257-666ba1882a97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:00 user nova-compute[74934]: INFO nova.compute.manager [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Terminating instance
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-b60b53f4-9cc4-4d53-9284-3628438f6d71 req-ddae96ef-ae4b-4c57-8928-c2a1dbd5477d service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b60b53f4-9cc4-4d53-9284-3628438f6d71 req-ddae96ef-ae4b-4c57-8928-c2a1dbd5477d service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b60b53f4-9cc4-4d53-9284-3628438f6d71 req-ddae96ef-ae4b-4c57-8928-c2a1dbd5477d service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b60b53f4-9cc4-4d53-9284-3628438f6d71 req-ddae96ef-ae4b-4c57-8928-c2a1dbd5477d service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-b60b53f4-9cc4-4d53-9284-3628438f6d71 req-ddae96ef-ae4b-4c57-8928-c2a1dbd5477d service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:00 user nova-compute[74934]: WARNING nova.compute.manager [req-b60b53f4-9cc4-4d53-9284-3628438f6d71 req-ddae96ef-ae4b-4c57-8928-c2a1dbd5477d service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state stopped and task_state powering-on.
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b is timed out.
Nov 19 14:57:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully detached device vdb from instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b from the live domain config.
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DZFKRwMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:57:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d9110e-abd6-4576-8d61-01aea0c745cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:57:00 user nova-compute[74934]: No targets found.
Nov 19 14:57:00 user nova-compute[74934]: iSNS:
Nov 19 14:57:00 user nova-compute[74934]: No targets found.
Nov 19 14:57:00 user nova-compute[74934]: STATIC:
Nov 19 14:57:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717
Nov 19 14:57:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:57:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:57:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:57:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:57:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:57:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:57:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:57:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:57:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5
Nov 19 14:57:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:57:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:57:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:57:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:57:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:57:00 user nova-compute[74934]: FIRMWARE:
Nov 19 14:57:00 user nova-compute[74934]: No targets found.
Nov 19 14:57:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:57:00 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:57:00 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a277fd-ed44-49f0-bb79-2a2c7203879a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3316d87a-5b4a-4637-b10f-ab9c62b43624]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:57:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:57:00 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:57:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c44456c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717'): ({'sde'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Removing single pathed devices sde {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.058s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185977e-643f-45e4-8927-3a3590eb8959]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:57:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Creating image(s)
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Ensure instance console log exists: /opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Start _get_guest_xml network_info=[{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '828f5471-cf3a-4e90-b2b2-a75fbabe444c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f03aa92d-6048-4c69-b275-deed31447a37', 'attached_at': '', 'detached_at': '', 'volume_id': '544e5d76-baf5-48d1-ac1c-07147b08ef06', 'serial': '544e5d76-baf5-48d1-ac1c-07147b08ef06'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5447a4-13b5-4aff-9c61-5e3952142264]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.network.neutron [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flushing IO for device /dev/sde {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[216b56b4-4f90-4793-bca8-450582ca11d2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-e886f3aa-b784-4105-b037-6b96899b85c6 req-ab3e2af5-8ed7-4538-83bd-2dc62cdbb500 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-vif-unplugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e886f3aa-b784-4105-b037-6b96899b85c6 req-ab3e2af5-8ed7-4538-83bd-2dc62cdbb500 service nova] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e886f3aa-b784-4105-b037-6b96899b85c6 req-ab3e2af5-8ed7-4538-83bd-2dc62cdbb500 service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e886f3aa-b784-4105-b037-6b96899b85c6 req-ab3e2af5-8ed7-4538-83bd-2dc62cdbb500 service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-e886f3aa-b784-4105-b037-6b96899b85c6 req-ab3e2af5-8ed7-4538-83bd-2dc62cdbb500 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] No waiting events found dispatching network-vif-unplugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-e886f3aa-b784-4105-b037-6b96899b85c6 req-ab3e2af5-8ed7-4538-83bd-2dc62cdbb500 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-vif-unplugged-e96f7c53-3895-4533-86e0-c708489515cf for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Instance destroyed successfully.
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lazy-loading 'resources' on Instance uuid 417da1fc-af51-4c8b-8257-666ba1882a97 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:57:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-586399447',display_name='tempest-ServersNegativeTestJSON-server-586399447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-586399447',id=24,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6785ce4d07724430bc04f3b8fa17a17f',ramdisk_id='',reservation_id='r-dbwga6tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1797626430',owner_user_name='tempest-ServersNegativeTestJSON-1797626430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:55:17Z,user_data=None,user_id='0dcd4276cf8a406c9c4fe6416d1a6542',uuid=417da1fc-af51-4c8b-8257-666ba1882a97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converting VIF {"id": "e96f7c53-3895-4533-86e0-c708489515cf", "address": "fa:16:3e:4e:ef:85", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape96f7c53-38", "ovs_interfaceid": "e96f7c53-3895-4533-86e0-c708489515cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_vif [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape96f7c53-38, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9ef60-abfa-47ef-87af-c93e49f15c8e]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bf793e8-178e-4fd0-8bbe-504e270d62e8) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'vcpu_model' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff2b5c-b633-4bcf-ad67-cfce93b2f554]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: INFO os_vif [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:ef:85,bridge_name='br-int',has_traffic_filtering=True,id=e96f7c53-3895-4533-86e0-c708489515cf,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape96f7c53-38')
Nov 19 14:57:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Deleting instance files /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97_del
Nov 19 14:57:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Deletion of /opt/stack/data/nova/instances/417da1fc-af51-4c8b-8257-666ba1882a97_del complete
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.objects.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Object Instance<f03aa92d-6048-4c69-b275-deed31447a37> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:57:01 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5043ae1-c3a4-4f81-97c2-656875880bca]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260]
Nov 19 14:57:01 user nova-compute[74934]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717, portal: 172.16.0.220,3260] successful.
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:01 user nova-compute[74934]: INFO nova.compute.manager [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee7fafa-fc91-4208-b2f7-67f45bcb3717 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de6d14-8247-48a4-9608-c14405b4ae09]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.607s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== disconnect_volume: return (609ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.123s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:57:01 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:57:01 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444e991-7799-4b02-a1cf-95f835fed41c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:57:01 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b23ce7-725d-4ce9-94bf-ef2a5ef3823d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06] added
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe37b6a-da9e-455c-bdc2-d5e447f5eff1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[630823f3-b33a-4392-9bd8-4e6857db4fb0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwJyUMHG {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CwJyUMHG" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0005e7-f7bf-4c03-a2f0-9a1fc9228bee]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CwJyUMHG'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5352df11-30c8-4280-8daf-a6bbf3a22001]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc062b0-e237-4b64-9714-bcfcfe97007f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67209da-9f06-4396-92d3-ae56ecc6095e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]
Nov 19 14:57:01 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0ac79-e11d-435e-addc-33de48c98166]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67218c0-1934-4c83-9f26-332a934a0cf9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:57:01 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:57:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b18b9-686e-46ca-8d3d-18eef4ff8e8b]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updated VIF entry in instance network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73938996-8489-4a67-9781-1d5bcf110e5c req-2d92b657-95e6-411a-8854-9288fa470ba8 service nova] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-d6775713-927b-46d1-8d8b-ffd3e17d145a req-99a665dc-8800-4af2-a23f-5312fb5d3d53 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-vif-deleted-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:01 user nova-compute[74934]: INFO nova.compute.manager [req-d6775713-927b-46d1-8d8b-ffd3e17d145a req-99a665dc-8800-4af2-a23f-5312fb5d3d53 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Neutron deleted interface e96f7c53-3895-4533-86e0-c708489515cf; detaching it from the instance and deleting it from the info cache
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-d6775713-927b-46d1-8d8b-ffd3e17d145a req-99a665dc-8800-4af2-a23f-5312fb5d3d53 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-d6775713-927b-46d1-8d8b-ffd3e17d145a req-99a665dc-8800-4af2-a23f-5312fb5d3d53 service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Detach interface failed, port_id=e96f7c53-3895-4533-86e0-c708489515cf, reason: Instance 417da1fc-af51-4c8b-8257-666ba1882a97 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:57:01 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Took 0.86 seconds to deallocate network for instance.
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'flavor' on Instance uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-29d7ac0d-da3e-4308-bf29-c73a84f2dd91 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.279s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.775s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] <== connect_volume: return (1899ms) {'type': 'block', 'scsi_wwn': '23034346137393836', 'path': '/dev/sde'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034346137393836', 'path': '/dev/sde'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-785eabb3-c173-4467-8dbc-11442497428d req-35adcb4e-2624-4142-8b73-23f3547b7456 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-785eabb3-c173-4467-8dbc-11442497428d req-35adcb4e-2624-4142-8b73-23f3547b7456 service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-785eabb3-c173-4467-8dbc-11442497428d req-35adcb4e-2624-4142-8b73-23f3547b7456 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-785eabb3-c173-4467-8dbc-11442497428d req-35adcb4e-2624-4142-8b73-23f3547b7456 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-785eabb3-c173-4467-8dbc-11442497428d req-35adcb4e-2624-4142-8b73-23f3547b7456 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:02 user nova-compute[74934]: WARNING nova.compute.manager [req-785eabb3-c173-4467-8dbc-11442497428d req-35adcb4e-2624-4142-8b73-23f3547b7456 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state stopped and task_state powering-on.
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-1cc02a29-27a6-42f9-9b18-a53a7a557935 req-9306eb40-6637-44b4-85fc-56fa9c77305d service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received event network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1cc02a29-27a6-42f9-9b18-a53a7a557935 req-9306eb40-6637-44b4-85fc-56fa9c77305d service nova] Acquiring lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1cc02a29-27a6-42f9-9b18-a53a7a557935 req-9306eb40-6637-44b4-85fc-56fa9c77305d service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1cc02a29-27a6-42f9-9b18-a53a7a557935 req-9306eb40-6637-44b4-85fc-56fa9c77305d service nova] Lock "417da1fc-af51-4c8b-8257-666ba1882a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-1cc02a29-27a6-42f9-9b18-a53a7a557935 req-9306eb40-6637-44b4-85fc-56fa9c77305d service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] No waiting events found dispatching network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:02 user nova-compute[74934]: WARNING nova.compute.manager [req-1cc02a29-27a6-42f9-9b18-a53a7a557935 req-9306eb40-6637-44b4-85fc-56fa9c77305d service nova] [instance: 417da1fc-af51-4c8b-8257-666ba1882a97] Received unexpected event network-vif-plugged-e96f7c53-3895-4533-86e0-c708489515cf for instance with vm_state deleted and task_state None.
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:57:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:57:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6502MB free_disk=24.901756286621094GB free_vcpus=-5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance rebooted successfully.
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-06ee7628-ac6b-4f84-9997-9c793281758c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1484735444',display_name='tempest-TestShelveInstance-server-1484735444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1484735444',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1632405257',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='437e3d86ee8742cfba5cfe234a7cca84',ramdisk_id='',reservation_id='r-hyc90zbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1215943411',owner_user_name='tempest-TestShelveInstance-1215943411-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:56:51Z,user_data=None,user_id='63f4c7f018334c358470fe0104e709d1',uuid=f03aa92d-6048-4c69-b275-deed31447a37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converting VIF {"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'pci_devices' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.objects.base [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Object Instance<f03aa92d-6048-4c69-b275-deed31447a37> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:57:03 user nova-compute[74934]:   <uuid>f03aa92d-6048-4c69-b275-deed31447a37</uuid>
Nov 19 14:57:03 user nova-compute[74934]:   <name>instance-00000015</name>
Nov 19 14:57:03 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:57:03 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:57:03 user nova-compute[74934]:   <metadata>
Nov 19 14:57:03 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:57:03 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:57:03 user nova-compute[74934]:       <nova:name>tempest-TestShelveInstance-server-1484735444</nova:name>
Nov 19 14:57:03 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:57:00</nova:creationTime>
Nov 19 14:57:03 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:57:03 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:57:03 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:57:03 user nova-compute[74934]:       <nova:owner>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:user uuid="63f4c7f018334c358470fe0104e709d1">tempest-TestShelveInstance-1215943411-project-member</nova:user>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:project uuid="437e3d86ee8742cfba5cfe234a7cca84">tempest-TestShelveInstance-1215943411</nova:project>
Nov 19 14:57:03 user nova-compute[74934]:       </nova:owner>
Nov 19 14:57:03 user nova-compute[74934]:       <nova:ports>
Nov 19 14:57:03 user nova-compute[74934]:         <nova:port uuid="cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317">
Nov 19 14:57:03 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 14:57:03 user nova-compute[74934]:         </nova:port>
Nov 19 14:57:03 user nova-compute[74934]:       </nova:ports>
Nov 19 14:57:03 user nova-compute[74934]:     </nova:instance>
Nov 19 14:57:03 user nova-compute[74934]:   </metadata>
Nov 19 14:57:03 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:57:03 user nova-compute[74934]:     <system>
Nov 19 14:57:03 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:57:03 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:57:03 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:57:03 user nova-compute[74934]:       <entry name="serial">f03aa92d-6048-4c69-b275-deed31447a37</entry>
Nov 19 14:57:03 user nova-compute[74934]:       <entry name="uuid">f03aa92d-6048-4c69-b275-deed31447a37</entry>
Nov 19 14:57:03 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:57:03 user nova-compute[74934]:     </system>
Nov 19 14:57:03 user nova-compute[74934]:   </sysinfo>
Nov 19 14:57:03 user nova-compute[74934]:   <os>
Nov 19 14:57:03 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:57:03 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:57:03 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:57:03 user nova-compute[74934]:   </os>
Nov 19 14:57:03 user nova-compute[74934]:   <features>
Nov 19 14:57:03 user nova-compute[74934]:     <acpi/>
Nov 19 14:57:03 user nova-compute[74934]:     <apic/>
Nov 19 14:57:03 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:57:03 user nova-compute[74934]:   </features>
Nov 19 14:57:03 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:57:03 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:57:03 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:57:03 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:57:03 user nova-compute[74934]:   </clock>
Nov 19 14:57:03 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:57:03 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:57:03 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:57:03 user nova-compute[74934]:   </cpu>
Nov 19 14:57:03 user nova-compute[74934]:   <devices>
Nov 19 14:57:03 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:57:03 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:57:03 user nova-compute[74934]:       <source dev="/dev/sde"/>
Nov 19 14:57:03 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:57:03 user nova-compute[74934]:       <serial>544e5d76-baf5-48d1-ac1c-07147b08ef06</serial>
Nov 19 14:57:03 user nova-compute[74934]:     </disk>
Nov 19 14:57:03 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:57:03 user nova-compute[74934]:       <mac address="fa:16:3e:3d:9c:34"/>
Nov 19 14:57:03 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:57:03 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:57:03 user nova-compute[74934]:       <target dev="tapcea6ddd2-1d"/>
Nov 19 14:57:03 user nova-compute[74934]:     </interface>
Nov 19 14:57:03 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:57:03 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37/console.log" append="off"/>
Nov 19 14:57:03 user nova-compute[74934]:     </serial>
Nov 19 14:57:03 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:57:03 user nova-compute[74934]:     <video>
Nov 19 14:57:03 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:57:03 user nova-compute[74934]:     </video>
Nov 19 14:57:03 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:57:03 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:57:03 user nova-compute[74934]:     </rng>
Nov 19 14:57:03 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:57:03 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:57:03 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:57:03 user nova-compute[74934]:     </memballoon>
Nov 19 14:57:03 user nova-compute[74934]:   </devices>
Nov 19 14:57:03 user nova-compute[74934]: </domain>
Nov 19 14:57:03 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1484735444',display_name='tempest-TestShelveInstance-server-1484735444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1484735444',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1632405257',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='437e3d86ee8742cfba5cfe234a7cca84',ramdisk_id='',reservation_id='r-hyc90zbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1215943411',owner_user_name='tempest-TestShelveInstance-1215943411-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:56:51Z,user_data=None,user_id='63f4c7f018334c358470fe0104e709d1',uuid=f03aa92d-6048-4c69-b275-deed31447a37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converting VIF {"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG os_vif [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c3a3120-fbae-56ee-8082-ef954217e426', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcea6ddd2-1d, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcea6ddd2-1d, col_values=(('qos', UUID('d1902044-483a-4df8-8154-5d5f76adda43')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcea6ddd2-1d, col_values=(('external_ids', {'iface-id': 'cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:9c:34', 'vm-uuid': 'f03aa92d-6048-4c69-b275-deed31447a37'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:03 user nova-compute[74934]: INFO os_vif [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d')
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] No VIF found with MAC fa:16:3e:3d:9c:34, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.302s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.411s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:03 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Deleted allocations for instance 417da1fc-af51-4c8b-8257-666ba1882a97
Nov 19 14:57:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1fd0e9ee-b562-4904-9e1a-6c971a6ba3ad tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "417da1fc-af51-4c8b-8257-666ba1882a97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.349s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fee595d0-5f2c-4e12-8806-b28e02675c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c5babe01-769c-495d-8e4b-de93e49bc012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 9c47cca7-32d5-44a6-8347-5138a98473fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 2f7bf511-949f-4273-b8c6-1fe3512cae48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (a6d80b64-40fb-4268-950b-1de97ecbab67): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:57:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=16GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:04 user nova-compute[74934]: WARNING nova.compute.manager [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:04 user nova-compute[74934]: WARNING nova.compute.manager [req-836c3111-0186-410a-bfe6-aaab7362b7c1 req-fd9fe595-500c-46a1-b14c-e7561ac6785e service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 19 14:57:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-changed-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Refreshing instance network info cache due to event network-changed-6f242ee2-4b9e-4d39-9534-7cf20e355413. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Refreshing network info cache for port 6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:57:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance spawned successfully.
Nov 19 14:57:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:57:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-715bead9-23eb-48f9-8434-4565db614cdb tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.693s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:07 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updated VIF entry in instance network info cache for port 6f242ee2-4b9e-4d39-9534-7cf20e355413. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:57:07 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d0d9382-bda8-4558-ae0d-4762f2445fda req-4d02c62e-b10e-43ad-a2e1-d9053f564029 service nova] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:11 user nova-compute[74934]: INFO nova.compute.manager [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Terminating instance
Nov 19 14:57:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-df6d127f-95d1-4f39-87ac-231bdd5016b4 req-ad5083c7-9347-4939-a0e1-5e0d40f99661 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-df6d127f-95d1-4f39-87ac-231bdd5016b4 req-ad5083c7-9347-4939-a0e1-5e0d40f99661 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-df6d127f-95d1-4f39-87ac-231bdd5016b4 req-ad5083c7-9347-4939-a0e1-5e0d40f99661 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-df6d127f-95d1-4f39-87ac-231bdd5016b4 req-ad5083c7-9347-4939-a0e1-5e0d40f99661 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-df6d127f-95d1-4f39-87ac-231bdd5016b4 req-ad5083c7-9347-4939-a0e1-5e0d40f99661 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-df6d127f-95d1-4f39-87ac-231bdd5016b4 req-ad5083c7-9347-4939-a0e1-5e0d40f99661 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-unplugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:57:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Instance destroyed successfully.
Nov 19 14:57:12 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'resources' on Instance uuid fee595d0-5f2c-4e12-8806-b28e02675c74 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2020451631',display_name='tempest-TestMinimumBasicScenario-server-2020451631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2020451631',id=18,image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPtF8JoIZC0ogO5nssLwdJYOBPPqpTDNBB0Ox0buLQsOyh7QyME+jgiWq2dcAo/ewyMXh6xaxZnybVWDGcALXuhXW5WyuIBR+XV3tM3QHLbjsRDoRrDLz3ZgXVSb4Oa9w==',key_name='tempest-TestMinimumBasicScenario-489823040',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-5ps226ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9959537f-405f-458f-ba5a-6f1f5e948203',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:54:33Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=fee595d0-5f2c-4e12-8806-b28e02675c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "469efd39-a7d3-4ba1-a81e-105842842227", "address": "fa:16:3e:17:b2:72", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469efd39-a7", "ovs_interfaceid": "469efd39-a7d3-4ba1-a81e-105842842227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG os_vif [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469efd39-a7, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eda57322-c9dd-4f29-b66e-9b156a89f3b2) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:12 user nova-compute[74934]: INFO os_vif [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b2:72,bridge_name='br-int',has_traffic_filtering=True,id=469efd39-a7d3-4ba1-a81e-105842842227,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469efd39-a7')
Nov 19 14:57:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Deleting instance files /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74_del
Nov 19 14:57:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Deletion of /opt/stack/data/nova/instances/fee595d0-5f2c-4e12-8806-b28e02675c74_del complete
Nov 19 14:57:12 user nova-compute[74934]: INFO nova.compute.manager [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 19 14:57:12 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:57:12 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:13 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Took 0.75 seconds to deallocate network for instance.
Nov 19 14:57:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-089b4da2-19f0-4939-bcab-29aec3973ca3 req-5cab2f43-0af4-4d6f-a2f6-083e60473048 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-deleted-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:13 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Deleted allocations for instance fee595d0-5f2c-4e12-8806-b28e02675c74
Nov 19 14:57:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-9c432df9-55cb-41f2-ae81-29c4e9cb4a08 req-8770a6f2-3b3e-4e87-9f81-1a527ff7fdb3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c432df9-55cb-41f2-ae81-29c4e9cb4a08 req-8770a6f2-3b3e-4e87-9f81-1a527ff7fdb3 service nova] Acquiring lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c432df9-55cb-41f2-ae81-29c4e9cb4a08 req-8770a6f2-3b3e-4e87-9f81-1a527ff7fdb3 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9c432df9-55cb-41f2-ae81-29c4e9cb4a08 req-8770a6f2-3b3e-4e87-9f81-1a527ff7fdb3 service nova] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-9c432df9-55cb-41f2-ae81-29c4e9cb4a08 req-8770a6f2-3b3e-4e87-9f81-1a527ff7fdb3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] No waiting events found dispatching network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:13 user nova-compute[74934]: WARNING nova.compute.manager [req-9c432df9-55cb-41f2-ae81-29c4e9cb4a08 req-8770a6f2-3b3e-4e87-9f81-1a527ff7fdb3 service nova] [instance: fee595d0-5f2c-4e12-8806-b28e02675c74] Received unexpected event network-vif-plugged-469efd39-a7d3-4ba1-a81e-105842842227 for instance with vm_state deleted and task_state None.
Nov 19 14:57:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5de11f96-638e-46df-9651-af3dbe996a8f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "fee595d0-5f2c-4e12-8806-b28e02675c74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-changed-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Refreshing instance network info cache due to event network-changed-0464bf6f-4d6b-4f51-aa17-d450f0bb3878. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] Acquiring lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] Acquired lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Refreshing network info cache for port 0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:19 user nova-compute[74934]: INFO nova.compute.manager [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Terminating instance
Nov 19 14:57:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Updated VIF entry in instance network info cache for port 0464bf6f-4d6b-4f51-aa17-d450f0bb3878. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Updating instance_info_cache with network_info: [{"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-facb8054-47b8-4d8d-8c9c-f7354419aee3 req-b4017fd3-6a0d-4954-be89-b617f1ff970d service nova] Releasing lock "refresh_cache-9c47cca7-32d5-44a6-8347-5138a98473fc" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ab004ccc-3307-4e24-9bb9-20dca5847ce5 req-d8062235-e836-4b36-a419-fedb0199d6eb service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-vif-unplugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ab004ccc-3307-4e24-9bb9-20dca5847ce5 req-d8062235-e836-4b36-a419-fedb0199d6eb service nova] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ab004ccc-3307-4e24-9bb9-20dca5847ce5 req-d8062235-e836-4b36-a419-fedb0199d6eb service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ab004ccc-3307-4e24-9bb9-20dca5847ce5 req-d8062235-e836-4b36-a419-fedb0199d6eb service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ab004ccc-3307-4e24-9bb9-20dca5847ce5 req-d8062235-e836-4b36-a419-fedb0199d6eb service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] No waiting events found dispatching network-vif-unplugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-ab004ccc-3307-4e24-9bb9-20dca5847ce5 req-d8062235-e836-4b36-a419-fedb0199d6eb service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-vif-unplugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Instance destroyed successfully.
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'resources' on Instance uuid 9c47cca7-32d5-44a6-8347-5138a98473fc {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1440162874',display_name='tempest-AttachVolumeNegativeTest-server-1440162874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1440162874',id=26,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODHBVAj22SRGi8LfaqBfANO/BDmvgXBv53R1fI2aZd076UVZALF+VTdxnDq0lC6w/Wk65KZK9dVnJz33toiPGuQ3hTV2Rg9dv0ZjEa1i13xlBPYpco79mRiWhyTQSMjzw==',key_name='tempest-keypair-158451627',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-ckdlazyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:55:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=9c47cca7-32d5-44a6-8347-5138a98473fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "address": "fa:16:3e:0b:05:38", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0464bf6f-4d", "ovs_interfaceid": "0464bf6f-4d6b-4f51-aa17-d450f0bb3878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG os_vif [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0464bf6f-4d, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aeaca0e-8b92-44b5-89df-b7e3c347a82c) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:20 user nova-compute[74934]: INFO os_vif [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:38,bridge_name='br-int',has_traffic_filtering=True,id=0464bf6f-4d6b-4f51-aa17-d450f0bb3878,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0464bf6f-4d')
Nov 19 14:57:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Deleting instance files /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc_del
Nov 19 14:57:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Deletion of /opt/stack/data/nova/instances/9c47cca7-32d5-44a6-8347-5138a98473fc_del complete
Nov 19 14:57:20 user nova-compute[74934]: INFO nova.compute.manager [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 19 14:57:20 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:57:20 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:57:21 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:21 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Took 0.69 seconds to deallocate network for instance.
Nov 19 14:57:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:21 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:57:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:57:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:21 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Deleted allocations for instance 9c47cca7-32d5-44a6-8347-5138a98473fc
Nov 19 14:57:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1a0-7f7b-4edf-8485-35604c41b387 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] Acquiring lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] Lock "9c47cca7-32d5-44a6-8347-5138a98473fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] No waiting events found dispatching network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:22 user nova-compute[74934]: WARNING nova.compute.manager [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received unexpected event network-vif-plugged-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 for instance with vm_state deleted and task_state None.
Nov 19 14:57:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-6903ded1-a84a-4d42-9a51-38da94651779 req-d05c4aa1-9495-4d20-b902-fa3ef369fc3e service nova] [instance: 9c47cca7-32d5-44a6-8347-5138a98473fc] Received event network-vif-deleted-0464bf6f-4d6b-4f51-aa17-d450f0bb3878 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing instance network info cache due to event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:57:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:57:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:57:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updated VIF entry in instance network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:57:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5a0a2c29-8243-4532-bdc0-da604fd2e246 req-ab300561-1689-4ed0-a12f-402b95ecd2ff service nova] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:30 user nova-compute[74934]: INFO nova.compute.manager [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Terminating instance
Nov 19 14:57:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:30 user nova-compute[74934]: INFO nova.compute.manager [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Shelving
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-13dfbaf3-3caa-4b54-a64d-514e93e45b2b req-4f5ffb57-890b-4bc9-af62-2f7778161d62 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-unplugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13dfbaf3-3caa-4b54-a64d-514e93e45b2b req-4f5ffb57-890b-4bc9-af62-2f7778161d62 service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13dfbaf3-3caa-4b54-a64d-514e93e45b2b req-4f5ffb57-890b-4bc9-af62-2f7778161d62 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13dfbaf3-3caa-4b54-a64d-514e93e45b2b req-4f5ffb57-890b-4bc9-af62-2f7778161d62 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-13dfbaf3-3caa-4b54-a64d-514e93e45b2b req-4f5ffb57-890b-4bc9-af62-2f7778161d62 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-unplugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-13dfbaf3-3caa-4b54-a64d-514e93e45b2b req-4f5ffb57-890b-4bc9-af62-2f7778161d62 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-unplugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Instance destroyed successfully.
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.objects.instance [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'resources' on Instance uuid 4e1f21d2-f784-49d3-b2f4-52f0226c048b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance destroyed successfully.
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964213297',display_name='tempest-ServerActionsTestOtherA-server-1667384912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964213297',id=16,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7BUBDk+mwq/G25w9oNvmbP7s6FB+a/JpUr7aZTk9Pqcry6VoWsygtGANdxOPdDD1+3EVI+ZkoTIkvxM7DRi4n6FFHnmiarrXth1XJhv1EKmLWhiVBJixe4uk06xQaXxQ==',key_name='tempest-keypair-688273119',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-d3000n5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=4e1f21d2-f784-49d3-b2f4-52f0226c048b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "d827e47e-9033-4f04-9987-837c6460c55a", "address": "fa:16:3e:61:2a:14", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd827e47e-90", "ovs_interfaceid": "d827e47e-9033-4f04-9987-837c6460c55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG os_vif [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd827e47e-90, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbf29585-ca57-49ea-a274-fabd5abfcb46) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: INFO os_vif [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:2a:14,bridge_name='br-int',has_traffic_filtering=True,id=d827e47e-9033-4f04-9987-837c6460c55a,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd827e47e-90')
Nov 19 14:57:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Deleting instance files /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b_del
Nov 19 14:57:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Deletion of /opt/stack/data/nova/instances/4e1f21d2-f784-49d3-b2f4-52f0226c048b_del complete
Nov 19 14:57:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Beginning cold snapshot process
Nov 19 14:57:31 user nova-compute[74934]: INFO nova.compute.manager [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 19 14:57:31 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk /opt/stack/data/nova/instances/snapshots/tmpw8dmr420/6ee03f820eb643a48861097778a72e81 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:32 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Took 0.89 seconds to deallocate network for instance.
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-bb92038c-77c0-40d5-89b1-1a450f019f26 req-30a23239-0c2b-4804-85de-692dd41fc3b7 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-deleted-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:32 user nova-compute[74934]: INFO nova.compute.manager [req-bb92038c-77c0-40d5-89b1-1a450f019f26 req-30a23239-0c2b-4804-85de-692dd41fc3b7 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Neutron deleted interface d827e47e-9033-4f04-9987-837c6460c55a; detaching it from the instance and deleting it from the info cache
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-bb92038c-77c0-40d5-89b1-1a450f019f26 req-30a23239-0c2b-4804-85de-692dd41fc3b7 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-bb92038c-77c0-40d5-89b1-1a450f019f26 req-30a23239-0c2b-4804-85de-692dd41fc3b7 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Detach interface failed, port_id=d827e47e-9033-4f04-9987-837c6460c55a, reason: Instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk /opt/stack/data/nova/instances/snapshots/tmpw8dmr420/6ee03f820eb643a48861097778a72e81" returned: 0 in 0.908s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:32 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Snapshot extracted, beginning image upload
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Acquiring lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] No waiting events found dispatching network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:32 user nova-compute[74934]: WARNING nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 4e1f21d2-f784-49d3-b2f4-52f0226c048b] Received unexpected event network-vif-plugged-d827e47e-9033-4f04-9987-837c6460c55a for instance with vm_state deleted and task_state None.
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-unplugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-unplugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:32 user nova-compute[74934]: WARNING nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-unplugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state active and task_state shelving_image_uploading.
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:57:32 user nova-compute[74934]: WARNING nova.compute.manager [req-fcf05c7b-822b-49a9-aa27-d5fc0932eb5a req-5f850588-3a6f-4895-a9cf-acc61def9d21 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state active and task_state shelving_image_uploading.
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:32 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Deleted allocations for instance 4e1f21d2-f784-49d3-b2f4-52f0226c048b
Nov 19 14:57:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-cf9f2317-930d-4ea5-be79-5e700c0494b5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "4e1f21d2-f784-49d3-b2f4-52f0226c048b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.799s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Snapshot image upload complete
Nov 19 14:57:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:57:34 user nova-compute[74934]: INFO nova.compute.manager [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Shelve offloading
Nov 19 14:57:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance destroyed successfully.
Nov 19 14:57:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:57:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:57:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:34 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance destroyed successfully.
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'resources' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1000508196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1000508196',id=27,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF52SJ24KTJ0lnzWRi8r66UQRZE0Nq+Tz/L+Qyegc5jvTCJzi3W3/p965wktN/fjJMaQSnGmtvBKzOO5CEabYrkYGC+m202XNwa9G6Rxk3CQ159oDFocUHAeSc8FMuFrjQ==',key_name='tempest-keypair-993746842',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-3hfbw7e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member',shelved_at='2023-11-19T14:57:34.805539',shelved_host='user',shelved_image_id='9454cb2f-8f43-4596-afd6-85c812402346'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG os_vif [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing instance network info cache due to event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG nova.network.neutron [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec88e767-be, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8170b81f-722a-4eca-a4d5-5e09ddb12314) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:35 user nova-compute[74934]: INFO os_vif [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be')
Nov 19 14:57:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Deleting instance files /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96_del
Nov 19 14:57:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Deletion of /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96_del complete
Nov 19 14:57:35 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Deleted allocations for instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96
Nov 19 14:57:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'numa_topology' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG nova.objects.base [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96> lazy-loaded attributes: resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updated VIF entry in instance network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapec88e767-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-94ed67a7-2a5f-48f9-b21e-653000dc720a req-d6955ba9-8da5-4fbc-bbfd-2a0f3359e3db service nova] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc555dac-4ef2-48e8-af91-c303c8183766 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.066s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 14:57:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:57:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:57:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:57:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:57:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:58:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6850MB free_disk=24.897045135498047GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c5babe01-769c-495d-8e4b-de93e49bc012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 2f7bf511-949f-4273-b8c6-1fe3512cae48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f03aa92d-6048-4c69-b275-deed31447a37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [{"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-73f74149-9044-4fd3-b73a-5082a7b0fd86" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:58:05 user nova-compute[74934]: INFO nova.compute.claims [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Claim successful on node user
Nov 19 14:58:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 14:58:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:58:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.policy [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c76ed73a0da4b2f8b6cf6022eb357d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11f5e39f366f4f78aa258740eb0f0fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:58:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Creating image(s)
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "/opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "/opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "c183e2f198d6c8631652080d1ec75f5a37cdd28d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "c183e2f198d6c8631652080d1ec75f5a37cdd28d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Successfully created port: 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG nova.virt.images [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ccdf6a89-114b-4a9d-9733-9d7141a7693d was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.part /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.part /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.converted" returned: 0 in 0.529s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "c183e2f198d6c8631652080d1ec75f5a37cdd28d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.803s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Successfully updated port: 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing instance network info cache due to event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "c183e2f198d6c8631652080d1ec75f5a37cdd28d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "c183e2f198d6c8631652080d1ec75f5a37cdd28d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d,backing_fmt=raw /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d,backing_fmt=raw /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk 1073741824" returned: 0 in 0.046s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "c183e2f198d6c8631652080d1ec75f5a37cdd28d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance network_info: |[{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.neutron [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d --force-share --output=json" returned: 0 in 0.162s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Cannot resize image /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Ensure instance console log exists: /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Start _get_guest_xml network_info=[{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:58:03Z,direct_url=<?>,disk_format='qcow2',id=ccdf6a89-114b-4a9d-9733-9d7141a7693d,min_disk=0,min_ram=0,name='tempest-scenario-img--507444014',owner='11f5e39f366f4f78aa258740eb0f0fae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:58:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'ccdf6a89-114b-4a9d-9733-9d7141a7693d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:58:08 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:58:08 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:58:03Z,direct_url=<?>,disk_format='qcow2',id=ccdf6a89-114b-4a9d-9733-9d7141a7693d,min_disk=0,min_ram=0,name='tempest-scenario-img--507444014',owner='11f5e39f366f4f78aa258740eb0f0fae',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:58:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-483511959',display_name='tempest-TestMinimumBasicScenario-server-483511959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-483511959',id=31,image_ref='ccdf6a89-114b-4a9d-9733-9d7141a7693d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5t/KNsPvi0AIviSihOMyVCGfq4jq+K+uCpT59aA/jxffE1fGE97WdYHzdeqj9h8jmKslK9A7Zqk8AmP4XKkp0bXUb1TUuqWonbdBgLYb6WaDyB36QisEtykP/UcLxtA==',key_name='tempest-TestMinimumBasicScenario-1561140614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-ocqndmsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ccdf6a89-114b-4a9d-9733-9d7141a7693d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:58:06Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=3c1e28e7-4514-4443-b365-da62a85bbc0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c1e28e7-4514-4443-b365-da62a85bbc0f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:58:08 user nova-compute[74934]:   <uuid>3c1e28e7-4514-4443-b365-da62a85bbc0f</uuid>
Nov 19 14:58:08 user nova-compute[74934]:   <name>instance-0000001f</name>
Nov 19 14:58:08 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:58:08 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:58:08 user nova-compute[74934]:   <metadata>
Nov 19 14:58:08 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:58:08 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:58:08 user nova-compute[74934]:       <nova:name>tempest-TestMinimumBasicScenario-server-483511959</nova:name>
Nov 19 14:58:08 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:58:08</nova:creationTime>
Nov 19 14:58:08 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:58:08 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:58:08 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:58:08 user nova-compute[74934]:       <nova:owner>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:user uuid="6c76ed73a0da4b2f8b6cf6022eb357d6">tempest-TestMinimumBasicScenario-2055579736-project-member</nova:user>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:project uuid="11f5e39f366f4f78aa258740eb0f0fae">tempest-TestMinimumBasicScenario-2055579736</nova:project>
Nov 19 14:58:08 user nova-compute[74934]:       </nova:owner>
Nov 19 14:58:08 user nova-compute[74934]:       <nova:root type="image" uuid="ccdf6a89-114b-4a9d-9733-9d7141a7693d"/>
Nov 19 14:58:08 user nova-compute[74934]:       <nova:ports>
Nov 19 14:58:08 user nova-compute[74934]:         <nova:port uuid="4770ca31-6eb7-4de3-9cf1-c303e9399dd3">
Nov 19 14:58:08 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 19 14:58:08 user nova-compute[74934]:         </nova:port>
Nov 19 14:58:08 user nova-compute[74934]:       </nova:ports>
Nov 19 14:58:08 user nova-compute[74934]:     </nova:instance>
Nov 19 14:58:08 user nova-compute[74934]:   </metadata>
Nov 19 14:58:08 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:58:08 user nova-compute[74934]:     <system>
Nov 19 14:58:08 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:58:08 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:58:08 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:58:08 user nova-compute[74934]:       <entry name="serial">3c1e28e7-4514-4443-b365-da62a85bbc0f</entry>
Nov 19 14:58:08 user nova-compute[74934]:       <entry name="uuid">3c1e28e7-4514-4443-b365-da62a85bbc0f</entry>
Nov 19 14:58:08 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:58:08 user nova-compute[74934]:     </system>
Nov 19 14:58:08 user nova-compute[74934]:   </sysinfo>
Nov 19 14:58:08 user nova-compute[74934]:   <os>
Nov 19 14:58:08 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:58:08 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:58:08 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:58:08 user nova-compute[74934]:   </os>
Nov 19 14:58:08 user nova-compute[74934]:   <features>
Nov 19 14:58:08 user nova-compute[74934]:     <acpi/>
Nov 19 14:58:08 user nova-compute[74934]:     <apic/>
Nov 19 14:58:08 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:58:08 user nova-compute[74934]:   </features>
Nov 19 14:58:08 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:58:08 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:58:08 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:58:08 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:58:08 user nova-compute[74934]:   </clock>
Nov 19 14:58:08 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:58:08 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:58:08 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:58:08 user nova-compute[74934]:   </cpu>
Nov 19 14:58:08 user nova-compute[74934]:   <devices>
Nov 19 14:58:08 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:58:08 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:58:08 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk"/>
Nov 19 14:58:08 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:58:08 user nova-compute[74934]:     </disk>
Nov 19 14:58:08 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:58:08 user nova-compute[74934]:       <mac address="fa:16:3e:e7:52:44"/>
Nov 19 14:58:08 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:58:08 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:58:08 user nova-compute[74934]:       <target dev="tap4770ca31-6e"/>
Nov 19 14:58:08 user nova-compute[74934]:     </interface>
Nov 19 14:58:08 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:58:08 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/console.log" append="off"/>
Nov 19 14:58:08 user nova-compute[74934]:     </serial>
Nov 19 14:58:08 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:58:08 user nova-compute[74934]:     <video>
Nov 19 14:58:08 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:58:08 user nova-compute[74934]:     </video>
Nov 19 14:58:08 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:58:08 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:58:08 user nova-compute[74934]:     </rng>
Nov 19 14:58:08 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:58:08 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:58:08 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:58:08 user nova-compute[74934]:     </memballoon>
Nov 19 14:58:08 user nova-compute[74934]:   </devices>
Nov 19 14:58:08 user nova-compute[74934]: </domain>
Nov 19 14:58:08 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-483511959',display_name='tempest-TestMinimumBasicScenario-server-483511959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-483511959',id=31,image_ref='ccdf6a89-114b-4a9d-9733-9d7141a7693d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5t/KNsPvi0AIviSihOMyVCGfq4jq+K+uCpT59aA/jxffE1fGE97WdYHzdeqj9h8jmKslK9A7Zqk8AmP4XKkp0bXUb1TUuqWonbdBgLYb6WaDyB36QisEtykP/UcLxtA==',key_name='tempest-TestMinimumBasicScenario-1561140614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-ocqndmsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ccdf6a89-114b-4a9d-9733-9d7141a7693d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:58:06Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=3c1e28e7-4514-4443-b365-da62a85bbc0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG os_vif [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f9239ad-9cde-5e0e-a3d6-d8fb5d3faac5', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4770ca31-6e, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4770ca31-6e, col_values=(('qos', UUID('ac6fbfee-4c9c-4c1b-9e47-8da591937033')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4770ca31-6e, col_values=(('external_ids', {'iface-id': '4770ca31-6eb7-4de3-9cf1-c303e9399dd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:52:44', 'vm-uuid': '3c1e28e7-4514-4443-b365-da62a85bbc0f'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:58:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:08 user nova-compute[74934]: INFO os_vif [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e')
Nov 19 14:58:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updated VIF entry in instance network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:58:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bedb6c3e-8e4d-4c3d-aab0-0351bc13413a req-7b5c0189-429f-45bb-84e4-6d41fb18961f service nova] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:58:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No VIF found with MAC fa:16:3e:e7:52:44, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-df131fc9-26da-4a33-9e77-99593de4b4f5 req-63098af2-e964-4db5-a6e1-360431233ef2 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-df131fc9-26da-4a33-9e77-99593de4b4f5 req-63098af2-e964-4db5-a6e1-360431233ef2 service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-df131fc9-26da-4a33-9e77-99593de4b4f5 req-63098af2-e964-4db5-a6e1-360431233ef2 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-df131fc9-26da-4a33-9e77-99593de4b4f5 req-63098af2-e964-4db5-a6e1-360431233ef2 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-df131fc9-26da-4a33-9e77-99593de4b4f5 req-63098af2-e964-4db5-a6e1-360431233ef2 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:10 user nova-compute[74934]: WARNING nova.compute.manager [req-df131fc9-26da-4a33-9e77-99593de4b4f5 req-63098af2-e964-4db5-a6e1-360431233ef2 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state building and task_state spawning.
Nov 19 14:58:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:11 user nova-compute[74934]: INFO nova.compute.manager [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Detaching volume 0aba1f0e-3122-4ac0-bb86-fe5def5939b5
Nov 19 14:58:11 user nova-compute[74934]: INFO nova.virt.block_device [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Attempting to driver detach volume 0aba1f0e-3122-4ac0-bb86-fe5def5939b5 from mountpoint /dev/vdb
Nov 19 14:58:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Attempting to detach device vdb from instance c5babe01-769c-495d-8e4b-de93e49bc012 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:58:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:58:11 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:11 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 14:58:11 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:11 user nova-compute[74934]:   <serial>0aba1f0e-3122-4ac0-bb86-fe5def5939b5</serial>
Nov 19 14:58:11 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:58:11 user nova-compute[74934]: </disk>
Nov 19 14:58:11 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:58:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully detached device vdb from instance c5babe01-769c-495d-8e4b-de93e49bc012 from the persistent domain config.
Nov 19 14:58:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5babe01-769c-495d-8e4b-de93e49bc012 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:58:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:58:11 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:11 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 14:58:11 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:11 user nova-compute[74934]:   <serial>0aba1f0e-3122-4ac0-bb86-fe5def5939b5</serial>
Nov 19 14:58:11 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:58:11 user nova-compute[74934]: </disk>
Nov 19 14:58:11 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:58:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:58:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance spawned successfully.
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:58:12 user nova-compute[74934]: INFO nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-7e0445b2-812b-4e3f-9b09-c24daec2c8ed req-3df00ff1-6956-495b-8f0e-d79570dd4905 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7e0445b2-812b-4e3f-9b09-c24daec2c8ed req-3df00ff1-6956-495b-8f0e-d79570dd4905 service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7e0445b2-812b-4e3f-9b09-c24daec2c8ed req-3df00ff1-6956-495b-8f0e-d79570dd4905 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7e0445b2-812b-4e3f-9b09-c24daec2c8ed req-3df00ff1-6956-495b-8f0e-d79570dd4905 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-7e0445b2-812b-4e3f-9b09-c24daec2c8ed req-3df00ff1-6956-495b-8f0e-d79570dd4905 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:12 user nova-compute[74934]: WARNING nova.compute.manager [req-7e0445b2-812b-4e3f-9b09-c24daec2c8ed req-3df00ff1-6956-495b-8f0e-d79570dd4905 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state building and task_state spawning.
Nov 19 14:58:12 user nova-compute[74934]: INFO nova.compute.manager [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Took 7.34 seconds to build instance.
Nov 19 14:58:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-805191b8-d876-4972-a840-3486568f9f89 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.428s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:21 user nova-compute[74934]: INFO nova.compute.manager [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Unrescuing
Nov 19 14:58:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'flavor' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a361a96-9741-496d-8d40-865b3690ec4d req-899ee38a-8348-41d8-bf6f-841eb57918c2 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a361a96-9741-496d-8d40-865b3690ec4d req-899ee38a-8348-41d8-bf6f-841eb57918c2 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a361a96-9741-496d-8d40-865b3690ec4d req-899ee38a-8348-41d8-bf6f-841eb57918c2 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a361a96-9741-496d-8d40-865b3690ec4d req-899ee38a-8348-41d8-bf6f-841eb57918c2 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a361a96-9741-496d-8d40-865b3690ec4d req-899ee38a-8348-41d8-bf6f-841eb57918c2 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:22 user nova-compute[74934]: WARNING nova.compute.manager [req-1a361a96-9741-496d-8d40-865b3690ec4d req-899ee38a-8348-41d8-bf6f-841eb57918c2 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:58:22 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance destroyed successfully.
Nov 19 14:58:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing instance network info cache due to event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:22 user nova-compute[74934]: DEBUG nova.network.neutron [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG nova.network.neutron [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updated VIF entry in instance network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG nova.network.neutron [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e5dfe27-67e9-4734-ab1f-fc9285c435fe req-4b3e9648-772d-49e4-aec5-2e39b061c1ed service nova] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:23 user nova-compute[74934]: INFO nova.compute.manager [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Terminating instance
Nov 19 14:58:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:24 user nova-compute[74934]: WARNING nova.compute.manager [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:24 user nova-compute[74934]: WARNING nova.compute.manager [req-0f1b6317-3f1e-4421-9058-41bd0abad2ca req-0329ea9d-0cb4-4cd1-b9ae-1aa3f184b312 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Instance destroyed successfully.
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lazy-loading 'resources' on Instance uuid 2f7bf511-949f-4273-b8c6-1fe3512cae48 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-285731068',display_name='tempest-VolumesActionsTest-instance-285731068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-285731068',id=28,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8be92c125fd34bef8e55fa83ef3d5f61',ramdisk_id='',reservation_id='r-q0he0mjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1012691079',owner_user_name='tempest-VolumesActionsTest-1012691079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:56:45Z,user_data=None,user_id='e87a983281b3497781f13b9e3aafa55a',uuid=2f7bf511-949f-4273-b8c6-1fe3512cae48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converting VIF {"id": "7a97d7d1-7747-4068-b89a-40c2d104600d", "address": "fa:16:3e:8a:b3:3c", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a97d7d1-77", "ovs_interfaceid": "7a97d7d1-7747-4068-b89a-40c2d104600d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG os_vif [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a97d7d1-77, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce41a182-dfd4-4f1e-913a-851a1422bbac) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: INFO os_vif [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b3:3c,bridge_name='br-int',has_traffic_filtering=True,id=7a97d7d1-7747-4068-b89a-40c2d104600d,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a97d7d1-77')
Nov 19 14:58:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Deleting instance files /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48_del
Nov 19 14:58:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Deletion of /opt/stack/data/nova/instances/2f7bf511-949f-4273-b8c6-1fe3512cae48_del complete
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:24 user nova-compute[74934]: INFO nova.compute.manager [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing instance network info cache due to event network-changed-d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] Acquiring lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] Acquired lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:24 user nova-compute[74934]: DEBUG nova.network.neutron [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Refreshing network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updated VIF entry in instance network info cache for port d8a80afc-d141-4ca8-a0b3-b0374f579f17. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [{"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d77f705b-a484-4183-bce2-69407d12d3e7 req-e3331c5a-76fc-4771-b284-c0ed55006b63 service nova] Releasing lock "refresh_cache-7a6dc86f-e21c-4789-9433-34c25d9bf56b" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:25 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Took 0.99 seconds to deallocate network for instance.
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing instance network info cache due to event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG nova.objects.instance [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'flavor' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:26 user nova-compute[74934]: INFO nova.compute.manager [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Attaching volume e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a to /dev/vdb
Nov 19 14:58:26 user nova-compute[74934]: DEBUG os_brick.utils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updated VIF entry in instance network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e70c83-cea9-4383-bc4c-d84e52699294]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b609c9f7-f790-4319-a4d9-e713a41164d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d23faa21-5d4b-488b-94bb-757a9b7118e1 req-14b30c0a-d463-431a-b4c3-d60de7a9108b service nova] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe6015-9e09-4fb4-85a3-55ee43bb27d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc7dac3-863c-4b59-abb9-f893a81da58f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:58:26 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c028e182-00b6-4769-b3e2-988de6189dee]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG os_brick.utils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating existing volume attachment record: 3e91b2ef-710c-47d6-ade5-4b22d966a8e5 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:58:26 user nova-compute[74934]: INFO nova.compute.manager [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] instance snapshotting
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.637s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:26 user nova-compute[74934]: WARNING nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state rescued and task_state unrescuing.
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received event network-vif-unplugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] No waiting events found dispatching network-vif-unplugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:26 user nova-compute[74934]: WARNING nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received unexpected event network-vif-unplugged-7a97d7d1-7747-4068-b89a-40c2d104600d for instance with vm_state deleted and task_state None.
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received event network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Acquiring lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] No waiting events found dispatching network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:26 user nova-compute[74934]: WARNING nova.compute.manager [req-fbc6d506-a9b2-4007-9e2d-f19c54990a4b req-4f783892-02b2-46e2-b220-47b115ecc794 service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received unexpected event network-vif-plugged-7a97d7d1-7747-4068-b89a-40c2d104600d for instance with vm_state deleted and task_state None.
Nov 19 14:58:26 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Deleted allocations for instance 2f7bf511-949f-4273-b8c6-1fe3512cae48
Nov 19 14:58:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Beginning live snapshot process
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8cfd9cd2-6acb-4dce-9f3b-0ef09d56c53d tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "2f7bf511-949f-4273-b8c6-1fe3512cae48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.651s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a2fca283-053a-42f7-aad8-e960336b58c8 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp00le8yvk/2e4ff97f79bd450c802fbdbc1f69a593.delta 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp00le8yvk/2e4ff97f79bd450c802fbdbc1f69a593.delta 1073741824" returned: 0 in 0.057s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 19 14:58:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-7652d9c0-1ec3-4456-bf0b-f0a82074ac18 req-3a5a8197-a43e-48c3-bf9d-cc5739e8e19f service nova] [instance: 2f7bf511-949f-4273-b8c6-1fe3512cae48] Received event network-vif-deleted-7a97d7d1-7747-4068-b89a-40c2d104600d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:58:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 14:58:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 19 14:58:28 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:58:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp00le8yvk/2e4ff97f79bd450c802fbdbc1f69a593.delta /opt/stack/data/nova/instances/snapshots/tmp00le8yvk/2e4ff97f79bd450c802fbdbc1f69a593 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp00le8yvk/2e4ff97f79bd450c802fbdbc1f69a593.delta /opt/stack/data/nova/instances/snapshots/tmp00le8yvk/2e4ff97f79bd450c802fbdbc1f69a593" returned: 0 in 0.723s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Snapshot extracted, beginning image upload
Nov 19 14:58:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5babe01-769c-495d-8e4b-de93e49bc012 is timed out.
Nov 19 14:58:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully detached device vdb from instance c5babe01-769c-495d-8e4b-de93e49bc012 from the live domain config.
Nov 19 14:58:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIxmQOFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:58:31 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb387619-4144-4bd0-b765-b5abd2824d33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:58:31 user nova-compute[74934]: No targets found.
Nov 19 14:58:31 user nova-compute[74934]: iSNS:
Nov 19 14:58:31 user nova-compute[74934]: No targets found.
Nov 19 14:58:31 user nova-compute[74934]: STATIC:
Nov 19 14:58:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:58:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:58:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5
Nov 19 14:58:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:58:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:58:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:31 user nova-compute[74934]: FIRMWARE:
Nov 19 14:58:31 user nova-compute[74934]: No targets found.
Nov 19 14:58:31 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:58:31 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:58:31 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a80e57c-403f-4512-a276-4eba5757fc10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c8549e-90f2-4583-939c-2e977a36a51c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:31 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:31 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:31 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4d72d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f221c09-ff9d-4c32-bec7-e97f50e9470c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[770b8a9c-f108-4fa8-996b-e758ee89c5a8]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9685898f-c4a8-4562-8ca2-25c8e8c1b83b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5039db8-886d-4a2f-8b0b-560a11e11678]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8fbd51-dd4f-4760-a7dd-8b1b889aab90]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Snapshot image upload complete
Nov 19 14:58:32 user nova-compute[74934]: INFO nova.compute.manager [None req-51a6118d-05eb-4843-8079-3b6a5c2f3928 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Took 5.74 seconds to snapshot the instance on the hypervisor.
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c5aab-ee76-48cf-a387-9dcb51ee8d33]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260]
Nov 19 14:58:32 user nova-compute[74934]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5, portal: 172.16.0.220,3260] successful.
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aba1f0e-3122-4ac0-bb86-fe5def5939b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e32f5-1434-4e48-8d3a-13ba886cbcb9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== disconnect_volume: return (328ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubcGTeLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:58:32 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:58:32 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:58:32 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24aca0b-54f1-4ee2-9fa4-20670471502f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:58:32 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c51eb-6e3d-44ee-a097-79ef104b0448]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a] added
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[74670aa9-a42e-410b-8b76-079e1322e55b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1adee8-010a-46a2-9724-482ca47fe790]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubcGTeLp {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubcGTeLp" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1047cdb-f4bf-4a9d-bfc1-67745b4fc60f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ubcGTeLp'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9825db9-a0bc-4076-9640-605a7fadc360]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ba955-885e-4518-8c02-d9bc260aed54]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0d5e7f-e6a6-4b33-8cf3-0f90734cac84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260]
Nov 19 14:58:32 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260] successful.
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c846b0-b6db-450f-8c49-49dcb8d7c674]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa8693-9142-4021-8406-7dbdd148a9da]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:32 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:58:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[26deacce-4205-46f7-8cec-64aa455a9409]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:58:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubcGTeLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9811cb8a-9f09-4ea7-b621-56305ff5d12e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.991s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23964626632386263', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964626632386263', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'flavor' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:58:33 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:33 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 14:58:33 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:33 user nova-compute[74934]:   <serial>e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a</serial>
Nov 19 14:58:33 user nova-compute[74934]: </disk>
Nov 19 14:58:33 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:58:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:58:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:58:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:bd:0a:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:58:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-948b5730-3429-4e24-a017-6cedc5c0092b tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.338s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:35 user nova-compute[74934]: INFO nova.compute.manager [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Rescuing
Nov 19 14:58:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-972f3e2c-eeae-41db-adef-e87ac2199c4d req-a1ac49e6-f3d8-4405-aeb1-087d22f32a20 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-972f3e2c-eeae-41db-adef-e87ac2199c4d req-a1ac49e6-f3d8-4405-aeb1-087d22f32a20 service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-972f3e2c-eeae-41db-adef-e87ac2199c4d req-a1ac49e6-f3d8-4405-aeb1-087d22f32a20 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-972f3e2c-eeae-41db-adef-e87ac2199c4d req-a1ac49e6-f3d8-4405-aeb1-087d22f32a20 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-972f3e2c-eeae-41db-adef-e87ac2199c4d req-a1ac49e6-f3d8-4405-aeb1-087d22f32a20 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:35 user nova-compute[74934]: WARNING nova.compute.manager [req-972f3e2c-eeae-41db-adef-e87ac2199c4d req-a1ac49e6-f3d8-4405-aeb1-087d22f32a20 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state active and task_state rescuing.
Nov 19 14:58:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance destroyed successfully.
Nov 19 14:58:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Attempting rescue
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74934) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 14:58:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Creating image(s)
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'migration_context' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.base [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<78b81733-fd30-4009-9945-0c34c3b88fbe> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Start _get_guest_xml network_info=[{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:bd:0a:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'resources' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.base [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<78b81733-fd30-4009-9945-0c34c3b88fbe> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'numa_topology' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.base [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<78b81733-fd30-4009-9945-0c34c3b88fbe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:58:36 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:58:36 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.base [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<78b81733-fd30-4009-9945-0c34c3b88fbe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-521385301',display_name='tempest-ServerRescueNegativeTestJSON-server-521385301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-521385301',id=29,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU25u6vlQLM4pT/EdPPLpw7XpBuyzy9Dan9CS0/h4hAKePRDZULoDhSjuLEkrX/OP3672WGh+4bUlDJsQS6bbquprDIJ6TvTyIKhMuKUoRqIQLytBgS3VE83Q5EPBB/sA==',key_name='tempest-keypair-1812534498',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-gdyhmcqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:56:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=78b81733-fd30-4009-9945-0c34c3b88fbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:bd:0a:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "vif_mac": "fa:16:3e:bd:0a:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'pci_devices' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.objects.base [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Object Instance<78b81733-fd30-4009-9945-0c34c3b88fbe> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:58:36 user nova-compute[74934]:   <uuid>78b81733-fd30-4009-9945-0c34c3b88fbe</uuid>
Nov 19 14:58:36 user nova-compute[74934]:   <name>instance-0000001d</name>
Nov 19 14:58:36 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:58:36 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:58:36 user nova-compute[74934]:   <metadata>
Nov 19 14:58:36 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:58:36 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:58:36 user nova-compute[74934]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-521385301</nova:name>
Nov 19 14:58:36 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:58:36</nova:creationTime>
Nov 19 14:58:36 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:58:36 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:58:36 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:58:36 user nova-compute[74934]:       <nova:owner>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:user uuid="cdbd678512a7438bac9bc337a0d94ecf">tempest-ServerRescueNegativeTestJSON-1330458851-project-member</nova:user>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:project uuid="0de5bebd7613411cb782d31ed1884da8">tempest-ServerRescueNegativeTestJSON-1330458851</nova:project>
Nov 19 14:58:36 user nova-compute[74934]:       </nova:owner>
Nov 19 14:58:36 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:58:36 user nova-compute[74934]:       <nova:ports>
Nov 19 14:58:36 user nova-compute[74934]:         <nova:port uuid="7a10bd8e-6da2-4738-8c7d-074dfeee726f">
Nov 19 14:58:36 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 14:58:36 user nova-compute[74934]:         </nova:port>
Nov 19 14:58:36 user nova-compute[74934]:       </nova:ports>
Nov 19 14:58:36 user nova-compute[74934]:     </nova:instance>
Nov 19 14:58:36 user nova-compute[74934]:   </metadata>
Nov 19 14:58:36 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:58:36 user nova-compute[74934]:     <system>
Nov 19 14:58:36 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:58:36 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:58:36 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:58:36 user nova-compute[74934]:       <entry name="serial">78b81733-fd30-4009-9945-0c34c3b88fbe</entry>
Nov 19 14:58:36 user nova-compute[74934]:       <entry name="uuid">78b81733-fd30-4009-9945-0c34c3b88fbe</entry>
Nov 19 14:58:36 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:58:36 user nova-compute[74934]:     </system>
Nov 19 14:58:36 user nova-compute[74934]:   </sysinfo>
Nov 19 14:58:36 user nova-compute[74934]:   <os>
Nov 19 14:58:36 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:58:36 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:58:36 user nova-compute[74934]:   </os>
Nov 19 14:58:36 user nova-compute[74934]:   <features>
Nov 19 14:58:36 user nova-compute[74934]:     <acpi/>
Nov 19 14:58:36 user nova-compute[74934]:     <apic/>
Nov 19 14:58:36 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:58:36 user nova-compute[74934]:   </features>
Nov 19 14:58:36 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:58:36 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:58:36 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:58:36 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:58:36 user nova-compute[74934]:   </clock>
Nov 19 14:58:36 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:58:36 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:58:36 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:58:36 user nova-compute[74934]:   </cpu>
Nov 19 14:58:36 user nova-compute[74934]:   <devices>
Nov 19 14:58:36 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:58:36 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:58:36 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue"/>
Nov 19 14:58:36 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:58:36 user nova-compute[74934]:     </disk>
Nov 19 14:58:36 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:58:36 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:58:36 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk"/>
Nov 19 14:58:36 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:58:36 user nova-compute[74934]:     </disk>
Nov 19 14:58:36 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:58:36 user nova-compute[74934]:       <mac address="fa:16:3e:bd:0a:7a"/>
Nov 19 14:58:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:58:36 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:58:36 user nova-compute[74934]:       <target dev="tap7a10bd8e-6d"/>
Nov 19 14:58:36 user nova-compute[74934]:     </interface>
Nov 19 14:58:36 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:58:36 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/console.log" append="off"/>
Nov 19 14:58:36 user nova-compute[74934]:     </serial>
Nov 19 14:58:36 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:58:36 user nova-compute[74934]:     <video>
Nov 19 14:58:36 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:58:36 user nova-compute[74934]:     </video>
Nov 19 14:58:36 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:58:36 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:58:36 user nova-compute[74934]:     </rng>
Nov 19 14:58:36 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:58:36 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:58:36 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:58:36 user nova-compute[74934]:     </memballoon>
Nov 19 14:58:36 user nova-compute[74934]:   </devices>
Nov 19 14:58:36 user nova-compute[74934]: </domain>
Nov 19 14:58:36 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:58:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance destroyed successfully.
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:58:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] No VIF found with MAC fa:16:3e:bd:0a:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:58:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-93bec776-8d9a-42ba-aed4-6f5972bb9fe3 req-4f2b694e-ef2e-4fb4-8527-e473fa8d8aca service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-93bec776-8d9a-42ba-aed4-6f5972bb9fe3 req-4f2b694e-ef2e-4fb4-8527-e473fa8d8aca service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-93bec776-8d9a-42ba-aed4-6f5972bb9fe3 req-4f2b694e-ef2e-4fb4-8527-e473fa8d8aca service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-93bec776-8d9a-42ba-aed4-6f5972bb9fe3 req-4f2b694e-ef2e-4fb4-8527-e473fa8d8aca service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-93bec776-8d9a-42ba-aed4-6f5972bb9fe3 req-4f2b694e-ef2e-4fb4-8527-e473fa8d8aca service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:37 user nova-compute[74934]: WARNING nova.compute.manager [req-93bec776-8d9a-42ba-aed4-6f5972bb9fe3 req-4f2b694e-ef2e-4fb4-8527-e473fa8d8aca service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state active and task_state rescuing.
Nov 19 14:58:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:39 user nova-compute[74934]: WARNING nova.compute.manager [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state active and task_state rescuing.
Nov 19 14:58:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:39 user nova-compute[74934]: WARNING nova.compute.manager [req-febe1adc-4134-44f5-b183-cc3f8091f784 req-0fce476e-760e-4dde-8ebd-d0fd8f18e33f service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state active and task_state rescuing.
Nov 19 14:58:40 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a244a666-92b9-4876-95ba-34fa956f1b74 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:58:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing instance network info cache due to event network-changed-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:58:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] Acquiring lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:58:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] Acquired lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:58:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Refreshing network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:42 user nova-compute[74934]: INFO nova.compute.manager [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Terminating instance
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-8999ca4e-297e-4cfb-ab1c-0c063b2bfdca req-f93bfd45-2c7b-4f97-a109-b37ee2f9b468 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-unplugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8999ca4e-297e-4cfb-ab1c-0c063b2bfdca req-f93bfd45-2c7b-4f97-a109-b37ee2f9b468 service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8999ca4e-297e-4cfb-ab1c-0c063b2bfdca req-f93bfd45-2c7b-4f97-a109-b37ee2f9b468 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8999ca4e-297e-4cfb-ab1c-0c063b2bfdca req-f93bfd45-2c7b-4f97-a109-b37ee2f9b468 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-8999ca4e-297e-4cfb-ab1c-0c063b2bfdca req-f93bfd45-2c7b-4f97-a109-b37ee2f9b468 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-unplugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-8999ca4e-297e-4cfb-ab1c-0c063b2bfdca req-f93bfd45-2c7b-4f97-a109-b37ee2f9b468 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-unplugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.network.neutron [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updated VIF entry in instance network info cache for port cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.network.neutron [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [{"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ec039997-b0ab-4a16-8eb0-aad45189fedb req-5ca3908d-5e48-4fe5-9573-ab526a3edf00 service nova] Releasing lock "refresh_cache-f03aa92d-6048-4c69-b275-deed31447a37" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Instance destroyed successfully.
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lazy-loading 'resources' on Instance uuid f03aa92d-6048-4c69-b275-deed31447a37 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1484735444',display_name='tempest-TestShelveInstance-server-1484735444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1484735444',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpFNOqUCNfVYd6dqGjV3IRxvVJqjXnkKpqMLcwHjKSGcWD2G2IiPCyXkGWFGmFXl/V6qoPJnZIuDxsE3q5wxqN0i2Hq2Iz6p2cfZVTDFoRT/hKvFziNFeIL0XLmR+9puw==',key_name='tempest-TestShelveInstance-1632405257',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='437e3d86ee8742cfba5cfe234a7cca84',ramdisk_id='',reservation_id='r-hyc90zbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1215943411',owner_user_name='tempest-TestShelveInstance-1215943411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:57:07Z,user_data=None,user_id='63f4c7f018334c358470fe0104e709d1',uuid=f03aa92d-6048-4c69-b275-deed31447a37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converting VIF {"id": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "address": "fa:16:3e:3d:9c:34", "network": {"id": "6620f937-e6c1-499b-ab65-7769831c6425", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314815248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "437e3d86ee8742cfba5cfe234a7cca84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcea6ddd2-1d", "ovs_interfaceid": "cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_vif [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcea6ddd2-1d, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1902044-483a-4df8-8154-5d5f76adda43) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:58:42 user nova-compute[74934]: INFO os_vif [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9c:34,bridge_name='br-int',has_traffic_filtering=True,id=cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317,network=Network(6620f937-e6c1-499b-ab65-7769831c6425),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcea6ddd2-1d')
Nov 19 14:58:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CwJyUMHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:58:42 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b733f52-7119-4ee9-8aa9-d3a8dbd3da96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:58:42 user nova-compute[74934]: No targets found.
Nov 19 14:58:42 user nova-compute[74934]: iSNS:
Nov 19 14:58:42 user nova-compute[74934]: No targets found.
Nov 19 14:58:42 user nova-compute[74934]: STATIC:
Nov 19 14:58:42 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:58:42 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:42 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:42 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 14:58:42 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:42 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:42 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:58:42 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:42 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:42 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06
Nov 19 14:58:42 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:42 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:42 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:58:42 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:58:42 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:58:42 user nova-compute[74934]: FIRMWARE:
Nov 19 14:58:42 user nova-compute[74934]: No targets found.
Nov 19 14:58:42 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:58:42 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:58:42 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:58:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26c3a27-11a0-44ff-959e-bfe3b4edc247]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[95275bb9-ce35-49e4-abbd-d4ccefa06dfe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:58:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 (non-flash)
Nov 19 14:58:43 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:58:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4446680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06'): ({'sde'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Removing single pathed devices sde {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[848424cd-8f3b-45ee-b8cc-e1ce785f31ff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0c4e6-e49a-484f-b861-1a44dda3ff32]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Flushing IO for device /dev/sde {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b60c95-1c83-4f39-a480-94f99470f20c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[069732f0-d2a4-465e-8fa5-d2708f7ce69f]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f30a6e-84e9-4a65-920e-f1af9e0b3155]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[91174cd0-de1c-436a-84bd-7c707c01c1b5]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260]
Nov 19 14:58:43 user nova-compute[74934]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06, portal: 172.16.0.220,3260] successful.
Nov 19 14:58:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:544e5d76-baf5-48d1-ac1c-07147b08ef06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf5938-9986-4d63-98a8-2f6c2e75c4ed]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] <== disconnect_volume: return (328ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:58:43 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Deleting instance files /opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37_del
Nov 19 14:58:43 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Deletion of /opt/stack/data/nova/instances/f03aa92d-6048-4c69-b275-deed31447a37_del complete
Nov 19 14:58:43 user nova-compute[74934]: INFO nova.compute.manager [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 19 14:58:43 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:58:43 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:58:43 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Took 0.45 seconds to deallocate network for instance.
Nov 19 14:58:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-d6e90b70-448b-46ce-9edf-1dde2614c407 req-5d0fc68e-d004-437c-b452-67956308a7f0 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-deleted-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:44 user nova-compute[74934]: INFO nova.compute.manager [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Took 0.75 seconds to detach 1 volumes for instance.
Nov 19 14:58:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Deleting volume: 544e5d76-baf5-48d1-ac1c-07147b08ef06 {{(pid=74934) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 19 14:58:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-2548330a-f5ba-4c74-b4eb-01ca84e22fa3 req-26e46f21-cad7-4b1f-aeec-541ba0e65700 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:58:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2548330a-f5ba-4c74-b4eb-01ca84e22fa3 req-26e46f21-cad7-4b1f-aeec-541ba0e65700 service nova] Acquiring lock "f03aa92d-6048-4c69-b275-deed31447a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2548330a-f5ba-4c74-b4eb-01ca84e22fa3 req-26e46f21-cad7-4b1f-aeec-541ba0e65700 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2548330a-f5ba-4c74-b4eb-01ca84e22fa3 req-26e46f21-cad7-4b1f-aeec-541ba0e65700 service nova] Lock "f03aa92d-6048-4c69-b275-deed31447a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:44 user nova-compute[74934]: DEBUG nova.compute.manager [req-2548330a-f5ba-4c74-b4eb-01ca84e22fa3 req-26e46f21-cad7-4b1f-aeec-541ba0e65700 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] No waiting events found dispatching network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:58:44 user nova-compute[74934]: WARNING nova.compute.manager [req-2548330a-f5ba-4c74-b4eb-01ca84e22fa3 req-26e46f21-cad7-4b1f-aeec-541ba0e65700 service nova] [instance: f03aa92d-6048-4c69-b275-deed31447a37] Received unexpected event network-vif-plugged-cea6ddd2-1dfb-4c94-a2e7-b3c13f1f9317 for instance with vm_state active and task_state deleting.
Nov 19 14:58:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:45 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Deleted allocations for instance f03aa92d-6048-4c69-b275-deed31447a37
Nov 19 14:58:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6fbc76f9-8ed7-4997-bda4-9ca42975ea60 tempest-TestShelveInstance-1215943411 tempest-TestShelveInstance-1215943411-project-member] Lock "f03aa92d-6048-4c69-b275-deed31447a37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.190s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:45 user nova-compute[74934]: INFO nova.compute.manager [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Detaching volume ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:58:45 user nova-compute[74934]: INFO nova.virt.block_device [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Attempting to driver detach volume ed26e3c0-5aab-4ea1-aa51-ad9e9475074b from mountpoint /dev/vdb
Nov 19 14:58:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Attempting to detach device vdb from instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:58:45 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:45 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:58:45 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:45 user nova-compute[74934]:   <serial>ed26e3c0-5aab-4ea1-aa51-ad9e9475074b</serial>
Nov 19 14:58:45 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:58:45 user nova-compute[74934]: </disk>
Nov 19 14:58:45 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:58:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully detached device vdb from instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 from the persistent domain config.
Nov 19 14:58:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:58:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:58:45 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:45 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:58:45 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:45 user nova-compute[74934]:   <serial>ed26e3c0-5aab-4ea1-aa51-ad9e9475074b</serial>
Nov 19 14:58:45 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 19 14:58:45 user nova-compute[74934]: </disk>
Nov 19 14:58:45 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:58:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:58:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:54 user nova-compute[74934]: INFO nova.compute.manager [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Detaching volume 8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:58:54 user nova-compute[74934]: INFO nova.virt.block_device [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Attempting to driver detach volume 8df2239b-b647-4fad-9dda-db5c994ab328 from mountpoint /dev/vdb
Nov 19 14:58:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Attempting to detach device vdb from instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 14:58:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:58:54 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:54 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 14:58:54 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:54 user nova-compute[74934]:   <serial>8df2239b-b647-4fad-9dda-db5c994ab328</serial>
Nov 19 14:58:54 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:58:54 user nova-compute[74934]: </disk>
Nov 19 14:58:54 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:58:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Successfully detached device vdb from instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b from the persistent domain config.
Nov 19 14:58:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 14:58:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 14:58:54 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:58:54 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 14:58:54 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:58:54 user nova-compute[74934]:   <serial>8df2239b-b647-4fad-9dda-db5c994ab328</serial>
Nov 19 14:58:54 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 14:58:54 user nova-compute[74934]: </disk>
Nov 19 14:58:54 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 14:58:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 14:58:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:58:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'flavor' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.196s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:00 user nova-compute[74934]: INFO nova.compute.manager [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Attaching volume fce5e560-3383-4690-9255-8b47f3f361ac to /dev/vdb
Nov 19 14:59:01 user nova-compute[74934]: DEBUG os_brick.utils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8455664-0370-4708-90af-8ab4e3da27f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88498e-30a6-4f2e-89be-401ac8c16ca0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f6ec43-01b1-4752-9525-d6330302963f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a8b9d5-de24-45a2-82f5-9fc076db2faa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:01 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fda2ad-59c7-4fc3-8148-840978d0c91a]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG os_brick.utils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating existing volume attachment record: f6791385-911f-4b2f-ad3c-f0fd3166c68c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7165MB free_disk=24.815704345703125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:02 user nova-compute[74934]: INFO nova.compute.manager [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Terminating instance
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-ddbe80f9-9e53-488f-b46e-d74b0485fc17 req-834c16b0-6145-498e-bdfb-4cecd63d7f07 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-vif-unplugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ddbe80f9-9e53-488f-b46e-d74b0485fc17 req-834c16b0-6145-498e-bdfb-4cecd63d7f07 service nova] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ddbe80f9-9e53-488f-b46e-d74b0485fc17 req-834c16b0-6145-498e-bdfb-4cecd63d7f07 service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ddbe80f9-9e53-488f-b46e-d74b0485fc17 req-834c16b0-6145-498e-bdfb-4cecd63d7f07 service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-ddbe80f9-9e53-488f-b46e-d74b0485fc17 req-834c16b0-6145-498e-bdfb-4cecd63d7f07 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] No waiting events found dispatching network-vif-unplugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-ddbe80f9-9e53-488f-b46e-d74b0485fc17 req-834c16b0-6145-498e-bdfb-4cecd63d7f07 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-vif-unplugged-525b6c1f-c7bc-4084-9728-d49cb10e849c for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c5babe01-769c-495d-8e4b-de93e49bc012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 3c1e28e7-4514-4443-b365-da62a85bbc0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 14:59:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Instance destroyed successfully.
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'resources' on Instance uuid c5babe01-769c-495d-8e4b-de93e49bc012 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1948935385',display_name='tempest-AttachVolumeNegativeTest-server-1948935385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1948935385',id=23,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKM74Gnie7UMNC42UHzBVlx2WQIEEh3HVH8RusExhd5ylQ51rvgR5+lRHpHINHAE0Z78RCIL4cZ117vfgmgjr/AuyUSM/kRRV5bm7xRBOvvQwF9q7EgnpgP1TWinFdNeA==',key_name='tempest-keypair-797971721',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-4abq1iio',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=c5babe01-769c-495d-8e4b-de93e49bc012,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "address": "fa:16:3e:75:60:00", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525b6c1f-c7", "ovs_interfaceid": "525b6c1f-c7bc-4084-9728-d49cb10e849c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG os_vif [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525b6c1f-c7, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeab0eaf-27eb-404a-9c20-80888f434476) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:02 user nova-compute[74934]: INFO os_vif [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:60:00,bridge_name='br-int',has_traffic_filtering=True,id=525b6c1f-c7bc-4084-9728-d49cb10e849c,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525b6c1f-c7')
Nov 19 14:59:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Deleting instance files /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012_del
Nov 19 14:59:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Deletion of /opt/stack/data/nova/instances/c5babe01-769c-495d-8e4b-de93e49bc012_del complete
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.891s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 14:59:02 user nova-compute[74934]: INFO nova.compute.manager [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:03 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Took 0.78 seconds to deallocate network for instance.
Nov 19 14:59:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:04 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Deleted allocations for instance c5babe01-769c-495d-8e4b-de93e49bc012
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f7b4b202-0887-470d-9e8d-3428d12deb79 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "c5babe01-769c-495d-8e4b-de93e49bc012" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] Acquiring lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] Lock "c5babe01-769c-495d-8e4b-de93e49bc012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] No waiting events found dispatching network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:04 user nova-compute[74934]: WARNING nova.compute.manager [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received unexpected event network-vif-plugged-525b6c1f-c7bc-4084-9728-d49cb10e849c for instance with vm_state deleted and task_state None.
Nov 19 14:59:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-b37ded35-33b0-4e1a-9b56-c8b9eb2c3872 req-b7073168-0439-40f8-ba63-896bad0c2b66 service nova] [instance: c5babe01-769c-495d-8e4b-de93e49bc012] Received event network-vif-deleted-525b6c1f-c7bc-4084-9728-d49cb10e849c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:06 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 is timed out.
Nov 19 14:59:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully detached device vdb from instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 from the live domain config.
Nov 19 14:59:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPiLAcBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0830309-2f12-4700-9ec3-b2fc33bdc236]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:59:06 user nova-compute[74934]: No targets found.
Nov 19 14:59:06 user nova-compute[74934]: iSNS:
Nov 19 14:59:06 user nova-compute[74934]: No targets found.
Nov 19 14:59:06 user nova-compute[74934]: STATIC:
Nov 19 14:59:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:59:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 14:59:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:59:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:06 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b
Nov 19 14:59:06 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:06 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:06 user nova-compute[74934]: FIRMWARE:
Nov 19 14:59:06 user nova-compute[74934]: No targets found.
Nov 19 14:59:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:59:06 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:59:06 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98b1d3-4bc6-4c2f-bd0f-9f245feb6767]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c5d461-55d6-40fe-a0ee-73161143c025]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:06 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:06 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:59:06 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:06 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:06 user nova-compute[74934]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b (non-flash)
Nov 19 14:59:06 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4444ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192d23e-59ad-4ea7-81a4-0207adc7629f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28f4f32-2ee3-4086-9dcc-df12deaddb39]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b00ec-efcc-4677-b097-0ccc59be9975]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[76709c93-6452-4dfe-bebf-f1f8e09fe0e8]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9deea-3cdd-47b0-9ebf-60e53c214b1a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51f3b65-fe57-4490-811e-794d79050c10]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260]
Nov 19 14:59:06 user nova-compute[74934]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed26e3c0-5aab-4ea1-aa51-ad9e9475074b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccbbb65-2165-4531-877c-ec4b95139fdc]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== disconnect_volume: return (293ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:06 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:06 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce18b8-b202-46b8-95b2-aa7194ad6561]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:59:06 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[20360fc4-4645-4d51-bdc0-1c01f2d29384]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac] added
Nov 19 14:59:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ac974-4c98-4218-ae7a-996429520725]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f149c0-639d-4856-9c21-bdd4f62e6c6f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfmkcpXA {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfmkcpXA" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f78d61-f060-4659-829e-fd1b0176d05e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfmkcpXA'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a0e1b3-13e1-4011-afb2-e273605938dc]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2afbdb-b301-4bd7-bf00-57e13ab02702]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a950b0f-2752-4d0b-a818-80038c3c6b96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]
Nov 19 14:59:07 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3423950c-0fbf-4ba8-965b-44c03fd5cb3d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fff8fe-40d9-484a-852e-37b3c85a957d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:07 user nova-compute[74934]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d9efa-b764-48a7-9a34-78f9e5a0dfba]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-dc639d80-4b41-40e7-8874-243c74757d84 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26230303530356337', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303530356337', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'flavor' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 14:59:08 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:59:08 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 14:59:08 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 14:59:08 user nova-compute[74934]:   <serial>fce5e560-3383-4690-9255-8b47f3f361ac</serial>
Nov 19 14:59:08 user nova-compute[74934]: </disk>
Nov 19 14:59:08 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74934) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No VIF found with MAC fa:16:3e:84:28:56, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-d05ba65b-833e-404c-9b02-cfc5a8878c70 req-eadd07bc-026b-472c-bd73-cc12c092be5f service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d05ba65b-833e-404c-9b02-cfc5a8878c70 req-eadd07bc-026b-472c-bd73-cc12c092be5f service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d05ba65b-833e-404c-9b02-cfc5a8878c70 req-eadd07bc-026b-472c-bd73-cc12c092be5f service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d05ba65b-833e-404c-9b02-cfc5a8878c70 req-eadd07bc-026b-472c-bd73-cc12c092be5f service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-d05ba65b-833e-404c-9b02-cfc5a8878c70 req-eadd07bc-026b-472c-bd73-cc12c092be5f service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:08 user nova-compute[74934]: WARNING nova.compute.manager [req-d05ba65b-833e-404c-9b02-cfc5a8878c70 req-eadd07bc-026b-472c-bd73-cc12c092be5f service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state active and task_state powering-off.
Nov 19 14:59:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5c6bb417-acae-4fd7-b9e3-9050e8216958 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.834s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance destroyed successfully.
Nov 19 14:59:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:59:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ce84474c-dc68-41cf-ae7d-4f697d021749 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.875s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-3ea36540-88f7-4628-90ab-4067bdf96f42 req-14240c77-b5fa-4f42-b247-c9e93ec3ca0c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3ea36540-88f7-4628-90ab-4067bdf96f42 req-14240c77-b5fa-4f42-b247-c9e93ec3ca0c service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3ea36540-88f7-4628-90ab-4067bdf96f42 req-14240c77-b5fa-4f42-b247-c9e93ec3ca0c service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3ea36540-88f7-4628-90ab-4067bdf96f42 req-14240c77-b5fa-4f42-b247-c9e93ec3ca0c service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-3ea36540-88f7-4628-90ab-4067bdf96f42 req-14240c77-b5fa-4f42-b247-c9e93ec3ca0c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:10 user nova-compute[74934]: WARNING nova.compute.manager [req-3ea36540-88f7-4628-90ab-4067bdf96f42 req-14240c77-b5fa-4f42-b247-c9e93ec3ca0c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state stopped and task_state None.
Nov 19 14:59:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Stashing vm_state: active {{(pid=74934) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:59:11 user nova-compute[74934]: INFO nova.compute.claims [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Claim successful on node user
Nov 19 14:59:11 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating resource usage from migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc
Nov 19 14:59:11 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.453s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:11 user nova-compute[74934]: INFO nova.compute.manager [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Migrating
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:11 user nova-compute[74934]: INFO nova.compute.rpcapi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Starting migrate_disk_and_power_off {{(pid=74934) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance destroyed successfully.
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f242ee2-4b, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=994ba579-94ee-4a0a-bea5-0a83fc9c3f4c) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:12 user nova-compute[74934]: INFO os_vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b')
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:12 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abbb91-8d75-4a20-b201-15a54e61fce4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:59:12 user nova-compute[74934]: No targets found.
Nov 19 14:59:12 user nova-compute[74934]: iSNS:
Nov 19 14:59:12 user nova-compute[74934]: No targets found.
Nov 19 14:59:12 user nova-compute[74934]: STATIC:
Nov 19 14:59:12 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:59:12 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:12 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:12 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 14:59:12 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:12 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:12 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:59:12 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:12 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:12 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 14:59:12 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:12 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:12 user nova-compute[74934]: FIRMWARE:
Nov 19 14:59:12 user nova-compute[74934]: No targets found.
Nov 19 14:59:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:59:12 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:59:12 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f8e13b-0798-452d-b567-e8f943b63711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f40bb-040b-47d4-a41e-54e674f6f794]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:12 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:12 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:12 user nova-compute[74934]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:12 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:12 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:12 user nova-compute[74934]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:12 user nova-compute[74934]: WARNING nova.compute.manager [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state active and task_state resize_migrating.
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:12 user nova-compute[74934]: WARNING nova.compute.manager [req-aaa3afe0-862e-46d5-99e6-deaddfd001c1 req-2180886f-cbfd-439c-92a9-3ce344a28e51 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state active and task_state resize_migrating.
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21a0c6-5f09-42ad-b615-84004d32d6d7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[34913dd8-8939-4542-97f1-fe6e135482c0]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5576ad4-1b9b-4477-a09f-4d34c908d0d7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:59:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6923e183-9ab5-477c-9002-80f3ef03de54]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[954be14d-282f-458b-b617-a84a948f0b41]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6952a1-9262-4c91-8353-a576cadafd49]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]
Nov 19 14:59:13 user nova-compute[74934]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:13 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b0cb6e-ae47-446f-88d1-b362b823defb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== disconnect_volume: return (298ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5_resize/disk /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "cp -r /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5_resize/disk /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk" returned: 0 in 0.361s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5_resize/disk.info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk.info {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "cp -r /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5_resize/disk.info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk.info" returned: 0 in 0.033s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Port 6f242ee2-4b9e-4d39-9534-7cf20e355413 binding to destination host user is already ACTIVE {{(pid=74934) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:15 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b is timed out.
Nov 19 14:59:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Successfully detached device vdb from instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b from the live domain config.
Nov 19 14:59:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrpudRbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:15 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5325b1-a1d0-492a-9adc-65713959da6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 14:59:15 user nova-compute[74934]: No targets found.
Nov 19 14:59:15 user nova-compute[74934]: iSNS:
Nov 19 14:59:15 user nova-compute[74934]: No targets found.
Nov 19 14:59:15 user nova-compute[74934]: STATIC:
Nov 19 14:59:15 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328
Nov 19 14:59:15 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:15 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:15 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 14:59:15 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:15 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:15 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 14:59:15 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 14:59:15 user nova-compute[74934]:                 Iface Name: default
Nov 19 14:59:15 user nova-compute[74934]: FIRMWARE:
Nov 19 14:59:15 user nova-compute[74934]: No targets found.
Nov 19 14:59:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 14:59:15 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 14:59:15 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6e687-532e-4dc6-801d-1a71a3b5b43d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc17526-679a-437c-9134-d600b41626bb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:15 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:15 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:15 user nova-compute[74934]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 (non-flash)
Nov 19 14:59:15 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328'): ({'sdg'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Removing single pathed devices sdg {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc8257-a141-46d9-a4ab-36c2b8777b40]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a3e0c9-6d8b-44fa-baf5-6262b0c24804]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Flushing IO for device /dev/sdg {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82bf58f-bfa3-4fd1-adbf-7b6693a92009]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e4535-cb40-4ce8-8b17-f9c8c83666c7]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[52721f10-04f9-4260-80b1-7fb78b0ee063]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4c21cf-b1e7-4c66-8d69-86d9c9f4c2d2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260]
Nov 19 14:59:15 user nova-compute[74934]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8df2239b-b647-4fad-9dda-db5c994ab328 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a435a-d614-48fb-91f3-49576ce57e2e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] <== disconnect_volume: return (314ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:59:15 user nova-compute[74934]: INFO nova.compute.claims [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Claim successful on node user
Nov 19 14:59:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.utils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[66205d98-6204-4bc0-8fa4-22abba1091eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[156d7606-e472-4d56-ba42-9675698d1da2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdfd77c-65ce-4421-8659-e9ed1333bcdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ac22e-8c0a-4d8b-abda-7143d7a595f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:15 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:59:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[436bc532-ad40-48cd-bcbf-66c36f8d4043]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:59:15 user nova-compute[74934]: DEBUG os_brick.utils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:59:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'flavor' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9d6edf73-3fc8-4f22-81d3-3094e58d8bf1 tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.policy [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e87a983281b3497781f13b9e3aafa55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be92c125fd34bef8e55fa83ef3d5f61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:59:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Creating image(s)
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "/opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "/opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.166s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk 1073741824" returned: 0 in 0.050s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Successfully created port: ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:59:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Cannot resize image /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Ensure instance console log exists: /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Successfully updated port: ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "refresh_cache-fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquired lock "refresh_cache-fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-changed-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Refreshing instance network info cache due to event network-changed-ec2bdd22-883d-4b84-8429-6196a203ae3e. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] Acquiring lock "refresh_cache-fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Updating instance_info_cache with network_info: [{"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Releasing lock "refresh_cache-fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Instance network_info: |[{"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] Acquired lock "refresh_cache-fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.neutron [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Refreshing network info cache for port ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Start _get_guest_xml network_info=[{"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:59:17 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:17 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-805686881',display_name='tempest-VolumesActionsTest-instance-805686881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-805686881',id=32,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8be92c125fd34bef8e55fa83ef3d5f61',ramdisk_id='',reservation_id='r-4yyp8d3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1012691079',owner_user_name='tempest-VolumesActionsTest-1012691079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:16Z,user_data=None,user_id='e87a983281b3497781f13b9e3aafa55a',uuid=fcdd2cd7-4a0d-4cf7-a12c-6919fe189202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converting VIF {"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lazy-loading 'pci_devices' on Instance uuid fcdd2cd7-4a0d-4cf7-a12c-6919fe189202 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:59:17 user nova-compute[74934]:   <uuid>fcdd2cd7-4a0d-4cf7-a12c-6919fe189202</uuid>
Nov 19 14:59:17 user nova-compute[74934]:   <name>instance-00000020</name>
Nov 19 14:59:17 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:59:17 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:59:17 user nova-compute[74934]:   <metadata>
Nov 19 14:59:17 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:59:17 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:59:17 user nova-compute[74934]:       <nova:name>tempest-VolumesActionsTest-instance-805686881</nova:name>
Nov 19 14:59:17 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:59:17</nova:creationTime>
Nov 19 14:59:17 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:59:17 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:59:17 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:59:17 user nova-compute[74934]:       <nova:owner>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:user uuid="e87a983281b3497781f13b9e3aafa55a">tempest-VolumesActionsTest-1012691079-project-member</nova:user>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:project uuid="8be92c125fd34bef8e55fa83ef3d5f61">tempest-VolumesActionsTest-1012691079</nova:project>
Nov 19 14:59:17 user nova-compute[74934]:       </nova:owner>
Nov 19 14:59:17 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:59:17 user nova-compute[74934]:       <nova:ports>
Nov 19 14:59:17 user nova-compute[74934]:         <nova:port uuid="ec2bdd22-883d-4b84-8429-6196a203ae3e">
Nov 19 14:59:17 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 19 14:59:17 user nova-compute[74934]:         </nova:port>
Nov 19 14:59:17 user nova-compute[74934]:       </nova:ports>
Nov 19 14:59:17 user nova-compute[74934]:     </nova:instance>
Nov 19 14:59:17 user nova-compute[74934]:   </metadata>
Nov 19 14:59:17 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:59:17 user nova-compute[74934]:     <system>
Nov 19 14:59:17 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:59:17 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:59:17 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:59:17 user nova-compute[74934]:       <entry name="serial">fcdd2cd7-4a0d-4cf7-a12c-6919fe189202</entry>
Nov 19 14:59:17 user nova-compute[74934]:       <entry name="uuid">fcdd2cd7-4a0d-4cf7-a12c-6919fe189202</entry>
Nov 19 14:59:17 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:59:17 user nova-compute[74934]:     </system>
Nov 19 14:59:17 user nova-compute[74934]:   </sysinfo>
Nov 19 14:59:17 user nova-compute[74934]:   <os>
Nov 19 14:59:17 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:59:17 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:59:17 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:59:17 user nova-compute[74934]:   </os>
Nov 19 14:59:17 user nova-compute[74934]:   <features>
Nov 19 14:59:17 user nova-compute[74934]:     <acpi/>
Nov 19 14:59:17 user nova-compute[74934]:     <apic/>
Nov 19 14:59:17 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:59:17 user nova-compute[74934]:   </features>
Nov 19 14:59:17 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:59:17 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:59:17 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:59:17 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:59:17 user nova-compute[74934]:   </clock>
Nov 19 14:59:17 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:59:17 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:59:17 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:59:17 user nova-compute[74934]:   </cpu>
Nov 19 14:59:17 user nova-compute[74934]:   <devices>
Nov 19 14:59:17 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:59:17 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:59:17 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk"/>
Nov 19 14:59:17 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:59:17 user nova-compute[74934]:     </disk>
Nov 19 14:59:17 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:59:17 user nova-compute[74934]:       <mac address="fa:16:3e:83:d5:7b"/>
Nov 19 14:59:17 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:17 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:59:17 user nova-compute[74934]:       <target dev="tapec2bdd22-88"/>
Nov 19 14:59:17 user nova-compute[74934]:     </interface>
Nov 19 14:59:17 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:59:17 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/console.log" append="off"/>
Nov 19 14:59:17 user nova-compute[74934]:     </serial>
Nov 19 14:59:17 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:59:17 user nova-compute[74934]:     <video>
Nov 19 14:59:17 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:17 user nova-compute[74934]:     </video>
Nov 19 14:59:17 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:59:17 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:59:17 user nova-compute[74934]:     </rng>
Nov 19 14:59:17 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:59:17 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:59:17 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:59:17 user nova-compute[74934]:     </memballoon>
Nov 19 14:59:17 user nova-compute[74934]:   </devices>
Nov 19 14:59:17 user nova-compute[74934]: </domain>
Nov 19 14:59:17 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-805686881',display_name='tempest-VolumesActionsTest-instance-805686881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-805686881',id=32,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8be92c125fd34bef8e55fa83ef3d5f61',ramdisk_id='',reservation_id='r-4yyp8d3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1012691079',owner_user_name='tempest-VolumesActionsTest-1012691079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:16Z,user_data=None,user_id='e87a983281b3497781f13b9e3aafa55a',uuid=fcdd2cd7-4a0d-4cf7-a12c-6919fe189202,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converting VIF {"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG os_vif [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd779ec04-2234-56ec-af4d-fbb3a284d934', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec2bdd22-88, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec2bdd22-88, col_values=(('qos', UUID('8ec83bc3-4645-4aa3-bc9e-3a98cdb850f7')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec2bdd22-88, col_values=(('external_ids', {'iface-id': 'ec2bdd22-883d-4b84-8429-6196a203ae3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:d5:7b', 'vm-uuid': 'fcdd2cd7-4a0d-4cf7-a12c-6919fe189202'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:17 user nova-compute[74934]: INFO os_vif [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88')
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] No VIF found with MAC fa:16:3e:83:d5:7b, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Updated VIF entry in instance network info cache for port ec2bdd22-883d-4b84-8429-6196a203ae3e. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:59:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Updating instance_info_cache with network_info: [{"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62fe98aa-a689-4000-9c30-faadc39df4e4 req-237c143c-8c1c-4ca1-bff6-325007004078 service nova] Releasing lock "refresh_cache-fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-e94b7e1f-de29-4bc2-bf0c-c6cad04bde58 req-2c807e02-942b-438b-b060-632ae0de131a service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e94b7e1f-de29-4bc2-bf0c-c6cad04bde58 req-2c807e02-942b-438b-b060-632ae0de131a service nova] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e94b7e1f-de29-4bc2-bf0c-c6cad04bde58 req-2c807e02-942b-438b-b060-632ae0de131a service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e94b7e1f-de29-4bc2-bf0c-c6cad04bde58 req-2c807e02-942b-438b-b060-632ae0de131a service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-e94b7e1f-de29-4bc2-bf0c-c6cad04bde58 req-2c807e02-942b-438b-b060-632ae0de131a service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] No waiting events found dispatching network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:19 user nova-compute[74934]: WARNING nova.compute.manager [req-e94b7e1f-de29-4bc2-bf0c-c6cad04bde58 req-2c807e02-942b-438b-b060-632ae0de131a service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received unexpected event network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e for instance with vm_state building and task_state spawning.
Nov 19 14:59:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-495e9ff4-da34-4a83-b7a5-bbe90f119f6e req-339afe2e-377d-44b0-bc2a-f7a702dfc5c9 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-495e9ff4-da34-4a83-b7a5-bbe90f119f6e req-339afe2e-377d-44b0-bc2a-f7a702dfc5c9 service nova] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-495e9ff4-da34-4a83-b7a5-bbe90f119f6e req-339afe2e-377d-44b0-bc2a-f7a702dfc5c9 service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-495e9ff4-da34-4a83-b7a5-bbe90f119f6e req-339afe2e-377d-44b0-bc2a-f7a702dfc5c9 service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-495e9ff4-da34-4a83-b7a5-bbe90f119f6e req-339afe2e-377d-44b0-bc2a-f7a702dfc5c9 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] No waiting events found dispatching network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:21 user nova-compute[74934]: WARNING nova.compute.manager [req-495e9ff4-da34-4a83-b7a5-bbe90f119f6e req-339afe2e-377d-44b0-bc2a-f7a702dfc5c9 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received unexpected event network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e for instance with vm_state building and task_state spawning.
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:59:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Instance spawned successfully.
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Starting finish_migration {{(pid=74934) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 14:59:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Creating image(s)
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:21 user nova-compute[74934]: INFO nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk. size=21474836480 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:21 user nova-compute[74934]: INFO nova.compute.manager [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Took 6.33 seconds to build instance.
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e1a631f7-d365-4760-b1a8-7cf0faebd02b tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.422s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk 21474836480 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk 21474836480" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Ensure instance console log exists: /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start _get_guest_xml network_info=[{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': 'b53fd89d-bb05-4d01-b08a-b09c1c5b0172', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e7afb3a2-f158-4399-9fdb-82cdb44362e5', 'attached_at': '2023-11-19T14:59:21.000000', 'detached_at': '', 'volume_id': 'fce5e560-3383-4690-9255-8b47f3f361ac', 'serial': 'fce5e560-3383-4690-9255-8b47f3f361ac'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:59:22 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:22 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:22 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:22 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:22 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4fcc28-a95b-421e-ac9f-4fcaead3e639]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:59:22 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[701bc126-09b0-4b8a-8b44-0d773dca3c4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac] added
Nov 19 14:59:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[854b7b1f-d5eb-4d0e-90fa-93fd614ebb8d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[548adc0a-eee2-419b-87e6-e6ec23fc613d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfmkcpXA {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfmkcpXA" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[387a0506-9065-4708-b69f-cd4cdb8c8dd7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfmkcpXA'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f4047-1ecd-4bfa-937a-7a77d4035b55]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff0fd5-6d6f-4e8a-afa2-ff240988fc9e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:22 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:22 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b000e5-9778-4976-8c52-39429e254fa5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]
Nov 19 14:59:22 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b13ae4-747a-4013-bd68-ad8a34e95481]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bb97b4-f8e7-48a1-a5af-559d7e88a8d9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:22 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:22 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:22 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:22 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a70fbf-808b-4cce-8470-236220a0caf1]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:59:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:23 user nova-compute[74934]: INFO nova.compute.manager [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Unshelving
Nov 19 14:59:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'pci_requests' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'numa_topology' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:59:23 user nova-compute[74934]: INFO nova.compute.claims [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Claim successful on node user
Nov 19 14:59:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26230303530356337', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303530356337', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:59:23 user nova-compute[74934]:   <uuid>e7afb3a2-f158-4399-9fdb-82cdb44362e5</uuid>
Nov 19 14:59:23 user nova-compute[74934]:   <name>instance-00000019</name>
Nov 19 14:59:23 user nova-compute[74934]:   <memory>2097152</memory>
Nov 19 14:59:23 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:59:23 user nova-compute[74934]:   <metadata>
Nov 19 14:59:23 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:59:23 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:59:23 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherB-server-1516657562</nova:name>
Nov 19 14:59:23 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:59:22</nova:creationTime>
Nov 19 14:59:23 user nova-compute[74934]:       <nova:flavor name="m1.small">
Nov 19 14:59:23 user nova-compute[74934]:         <nova:memory>2048</nova:memory>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:disk>20</nova:disk>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:59:23 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:59:23 user nova-compute[74934]:       <nova:owner>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:user uuid="5935830106b34079a0d046897dac49ba">tempest-ServerActionsTestOtherB-868500136-project-member</nova:user>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:project uuid="f186c71871084693a14881dce4328b46">tempest-ServerActionsTestOtherB-868500136</nova:project>
Nov 19 14:59:23 user nova-compute[74934]:       </nova:owner>
Nov 19 14:59:23 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:59:23 user nova-compute[74934]:       <nova:ports>
Nov 19 14:59:23 user nova-compute[74934]:         <nova:port uuid="6f242ee2-4b9e-4d39-9534-7cf20e355413">
Nov 19 14:59:23 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 19 14:59:23 user nova-compute[74934]:         </nova:port>
Nov 19 14:59:23 user nova-compute[74934]:       </nova:ports>
Nov 19 14:59:23 user nova-compute[74934]:     </nova:instance>
Nov 19 14:59:23 user nova-compute[74934]:   </metadata>
Nov 19 14:59:23 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:59:23 user nova-compute[74934]:     <system>
Nov 19 14:59:23 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:59:23 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:59:23 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:59:23 user nova-compute[74934]:       <entry name="serial">e7afb3a2-f158-4399-9fdb-82cdb44362e5</entry>
Nov 19 14:59:23 user nova-compute[74934]:       <entry name="uuid">e7afb3a2-f158-4399-9fdb-82cdb44362e5</entry>
Nov 19 14:59:23 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:59:23 user nova-compute[74934]:     </system>
Nov 19 14:59:23 user nova-compute[74934]:   </sysinfo>
Nov 19 14:59:23 user nova-compute[74934]:   <os>
Nov 19 14:59:23 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:59:23 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:59:23 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:59:23 user nova-compute[74934]:   </os>
Nov 19 14:59:23 user nova-compute[74934]:   <features>
Nov 19 14:59:23 user nova-compute[74934]:     <acpi/>
Nov 19 14:59:23 user nova-compute[74934]:     <apic/>
Nov 19 14:59:23 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:59:23 user nova-compute[74934]:   </features>
Nov 19 14:59:23 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:59:23 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:59:23 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:59:23 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:59:23 user nova-compute[74934]:   </clock>
Nov 19 14:59:23 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:59:23 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:59:23 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:59:23 user nova-compute[74934]:   </cpu>
Nov 19 14:59:23 user nova-compute[74934]:   <devices>
Nov 19 14:59:23 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:59:23 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:59:23 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk"/>
Nov 19 14:59:23 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:59:23 user nova-compute[74934]:     </disk>
Nov 19 14:59:23 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:59:23 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:59:23 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 14:59:23 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 14:59:23 user nova-compute[74934]:       <serial>fce5e560-3383-4690-9255-8b47f3f361ac</serial>
Nov 19 14:59:23 user nova-compute[74934]:     </disk>
Nov 19 14:59:23 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:59:23 user nova-compute[74934]:       <mac address="fa:16:3e:84:28:56"/>
Nov 19 14:59:23 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:23 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:59:23 user nova-compute[74934]:       <target dev="tap6f242ee2-4b"/>
Nov 19 14:59:23 user nova-compute[74934]:     </interface>
Nov 19 14:59:23 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:59:23 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/console.log" append="off"/>
Nov 19 14:59:23 user nova-compute[74934]:     </serial>
Nov 19 14:59:23 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:59:23 user nova-compute[74934]:     <video>
Nov 19 14:59:23 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:23 user nova-compute[74934]:     </video>
Nov 19 14:59:23 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:59:23 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:59:23 user nova-compute[74934]:     </rng>
Nov 19 14:59:23 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:59:23 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:59:23 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:59:23 user nova-compute[74934]:     </memballoon>
Nov 19 14:59:23 user nova-compute[74934]:   </devices>
Nov 19 14:59:23 user nova-compute[74934]: </domain>
Nov 19 14:59:23 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1934275186-network", "vif_mac": "fa:16:3e:84:28:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG os_vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '692b2f3d-3784-55a0-8709-dbcc69b3499a', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f242ee2-4b, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f242ee2-4b, col_values=(('qos', UUID('dcf34645-59e0-4f9c-aa2e-8effb71adb9a')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f242ee2-4b, col_values=(('external_ids', {'iface-id': '6f242ee2-4b9e-4d39-9534-7cf20e355413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:28:56', 'vm-uuid': 'e7afb3a2-f158-4399-9fdb-82cdb44362e5'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:23 user nova-compute[74934]: INFO os_vif [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b')
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] No VIF found with MAC fa:16:3e:84:28:56, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:24 user nova-compute[74934]: INFO nova.network.neutron [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating port ec88e767-be72-49c4-94a8-56d54e43569f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing instance network info cache due to event network-changed-ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:59:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] Acquiring lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:59:25 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Creating image(s)
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] Acquired lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Refreshing network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee71bc18-d83a-4989-87ae-1b6c58c8d715 req-c8dcd74f-f460-4f2b-9de5-1c474aa3253c service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee71bc18-d83a-4989-87ae-1b6c58c8d715 req-c8dcd74f-f460-4f2b-9de5-1c474aa3253c service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee71bc18-d83a-4989-87ae-1b6c58c8d715 req-c8dcd74f-f460-4f2b-9de5-1c474aa3253c service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee71bc18-d83a-4989-87ae-1b6c58c8d715 req-c8dcd74f-f460-4f2b-9de5-1c474aa3253c service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee71bc18-d83a-4989-87ae-1b6c58c8d715 req-c8dcd74f-f460-4f2b-9de5-1c474aa3253c service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:25 user nova-compute[74934]: WARNING nova.compute.manager [req-ee71bc18-d83a-4989-87ae-1b6c58c8d715 req-c8dcd74f-f460-4f2b-9de5-1c474aa3253c service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state active and task_state resize_finish.
Nov 19 14:59:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG nova.objects.base [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "da9de182a4edca08dcfa3eb462c7be8a959c6d3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "da9de182a4edca08dcfa3eb462c7be8a959c6d3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:26 user nova-compute[74934]: DEBUG nova.virt.images [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] 9454cb2f-8f43-4596-afd6-85c812402346 was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 14:59:26 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 14:59:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.part /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.part /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.converted" returned: 0 in 0.398s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.network.neutron [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updated VIF entry in instance network info cache for port ec88e767-be72-49c4-94a8-56d54e43569f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.network.neutron [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ca910be0-5116-4ce3-acba-e857e8eba0ae req-2f595e03-072b-4d8b-815c-028c14720b91 service nova] Releasing lock "refresh_cache-60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "da9de182a4edca08dcfa3eb462c7be8a959c6d3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.803s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "da9de182a4edca08dcfa3eb462c7be8a959c6d3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "da9de182a4edca08dcfa3eb462c7be8a959c6d3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-af14f537-bade-4f86-a9e4-2ec219930dc8 req-93646f81-d108-4c9f-89ac-d3447dbc357f service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-af14f537-bade-4f86-a9e4-2ec219930dc8 req-93646f81-d108-4c9f-89ac-d3447dbc357f service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-af14f537-bade-4f86-a9e4-2ec219930dc8 req-93646f81-d108-4c9f-89ac-d3447dbc357f service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-af14f537-bade-4f86-a9e4-2ec219930dc8 req-93646f81-d108-4c9f-89ac-d3447dbc357f service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.compute.manager [req-af14f537-bade-4f86-a9e4-2ec219930dc8 req-93646f81-d108-4c9f-89ac-d3447dbc357f service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:27 user nova-compute[74934]: WARNING nova.compute.manager [req-af14f537-bade-4f86-a9e4-2ec219930dc8 req-93646f81-d108-4c9f-89ac-d3447dbc357f service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state active and task_state resize_finish.
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b,backing_fmt=raw /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b,backing_fmt=raw /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk 1073741824" returned: 0 in 0.048s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "da9de182a4edca08dcfa3eb462c7be8a959c6d3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:59:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance running successfully.
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Failed to set time: agent not configured {{(pid=74934) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d7b227e8-6b5d-43a1-8ad1-79ef974398f1 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] finish_migration finished successfully. {{(pid=74934) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'migration_context' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:27 user nova-compute[74934]: DEBUG nova.objects.base [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:59:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Rebasing disk image.
Nov 19 14:59:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df -F raw /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:59:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:59:29 user nova-compute[74934]: INFO nova.compute.claims [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Claim successful on node user
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df -F raw /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk" returned: 0 in 2.301s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Ensure instance console log exists: /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Start _get_guest_xml network_info=[{"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='be165b170e41563b185af7451cc7d5cb',container_format='bare',created_at=2023-11-19T14:57:30Z,direct_url=<?>,disk_format='qcow2',id=9454cb2f-8f43-4596-afd6-85c812402346,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1000508196-shelved',owner='f1735667909d4b3e94e6be7ba9a5ec7f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-19T14:57:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:59:30 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:30 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='be165b170e41563b185af7451cc7d5cb',container_format='bare',created_at=2023-11-19T14:57:30Z,direct_url=<?>,disk_format='qcow2',id=9454cb2f-8f43-4596-afd6-85c812402346,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1000508196-shelved',owner='f1735667909d4b3e94e6be7ba9a5ec7f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-19T14:57:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.objects.base [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1000508196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1000508196',id=27,image_ref='9454cb2f-8f43-4596-afd6-85c812402346',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-993746842',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-3hfbw7e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member',shelved_at='2023-11-19T14:57:34.805539',shelved_host='user',shelved_image_id='9454cb2f-8f43-4596-afd6-85c812402346'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'pci_devices' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.objects.base [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Object Instance<60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:59:30 user nova-compute[74934]:   <uuid>60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96</uuid>
Nov 19 14:59:30 user nova-compute[74934]:   <name>instance-0000001b</name>
Nov 19 14:59:30 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:59:30 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:59:30 user nova-compute[74934]:   <metadata>
Nov 19 14:59:30 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:59:30 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:59:30 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1000508196</nova:name>
Nov 19 14:59:30 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:59:30</nova:creationTime>
Nov 19 14:59:30 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:59:30 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:59:30 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:59:30 user nova-compute[74934]:       <nova:owner>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:user uuid="ef44dc0981394f5fb42de977994f483d">tempest-AttachVolumeShelveTestJSON-884997441-project-member</nova:user>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:project uuid="f1735667909d4b3e94e6be7ba9a5ec7f">tempest-AttachVolumeShelveTestJSON-884997441</nova:project>
Nov 19 14:59:30 user nova-compute[74934]:       </nova:owner>
Nov 19 14:59:30 user nova-compute[74934]:       <nova:root type="image" uuid="9454cb2f-8f43-4596-afd6-85c812402346"/>
Nov 19 14:59:30 user nova-compute[74934]:       <nova:ports>
Nov 19 14:59:30 user nova-compute[74934]:         <nova:port uuid="ec88e767-be72-49c4-94a8-56d54e43569f">
Nov 19 14:59:30 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 19 14:59:30 user nova-compute[74934]:         </nova:port>
Nov 19 14:59:30 user nova-compute[74934]:       </nova:ports>
Nov 19 14:59:30 user nova-compute[74934]:     </nova:instance>
Nov 19 14:59:30 user nova-compute[74934]:   </metadata>
Nov 19 14:59:30 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:59:30 user nova-compute[74934]:     <system>
Nov 19 14:59:30 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:59:30 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:59:30 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:59:30 user nova-compute[74934]:       <entry name="serial">60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96</entry>
Nov 19 14:59:30 user nova-compute[74934]:       <entry name="uuid">60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96</entry>
Nov 19 14:59:30 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:59:30 user nova-compute[74934]:     </system>
Nov 19 14:59:30 user nova-compute[74934]:   </sysinfo>
Nov 19 14:59:30 user nova-compute[74934]:   <os>
Nov 19 14:59:30 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:59:30 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:59:30 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:59:30 user nova-compute[74934]:   </os>
Nov 19 14:59:30 user nova-compute[74934]:   <features>
Nov 19 14:59:30 user nova-compute[74934]:     <acpi/>
Nov 19 14:59:30 user nova-compute[74934]:     <apic/>
Nov 19 14:59:30 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:59:30 user nova-compute[74934]:   </features>
Nov 19 14:59:30 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:59:30 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:59:30 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:59:30 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:59:30 user nova-compute[74934]:   </clock>
Nov 19 14:59:30 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:59:30 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:59:30 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:59:30 user nova-compute[74934]:   </cpu>
Nov 19 14:59:30 user nova-compute[74934]:   <devices>
Nov 19 14:59:30 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:59:30 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:59:30 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk"/>
Nov 19 14:59:30 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:59:30 user nova-compute[74934]:     </disk>
Nov 19 14:59:30 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:59:30 user nova-compute[74934]:       <mac address="fa:16:3e:e1:01:04"/>
Nov 19 14:59:30 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:30 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:59:30 user nova-compute[74934]:       <target dev="tapec88e767-be"/>
Nov 19 14:59:30 user nova-compute[74934]:     </interface>
Nov 19 14:59:30 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:59:30 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/console.log" append="off"/>
Nov 19 14:59:30 user nova-compute[74934]:     </serial>
Nov 19 14:59:30 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:59:30 user nova-compute[74934]:     <video>
Nov 19 14:59:30 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:30 user nova-compute[74934]:     </video>
Nov 19 14:59:30 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:59:30 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:59:30 user nova-compute[74934]:     </rng>
Nov 19 14:59:30 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:59:30 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:59:30 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:59:30 user nova-compute[74934]:     </memballoon>
Nov 19 14:59:30 user nova-compute[74934]:   </devices>
Nov 19 14:59:30 user nova-compute[74934]: </domain>
Nov 19 14:59:30 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1000508196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1000508196',id=27,image_ref='9454cb2f-8f43-4596-afd6-85c812402346',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-993746842',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:55:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-3hfbw7e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member',shelved_at='2023-11-19T14:57:34.805539',shelved_host='user',shelved_image_id='9454cb2f-8f43-4596-afd6-85c812402346'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_vif [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cf7dae1-1a06-5f16-9448-e8fe7565e033', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec88e767-be, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec88e767-be, col_values=(('qos', UUID('510b39e0-5512-48dd-9ba5-ffb9d40df50e')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec88e767-be, col_values=(('external_ids', {'iface-id': 'ec88e767-be72-49c4-94a8-56d54e43569f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:01:04', 'vm-uuid': '60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:30 user nova-compute[74934]: INFO os_vif [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be')
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] No VIF found with MAC fa:16:3e:e1:01:04, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:59:30 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.policy [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77319d6b70b24f22b39342f6955a8fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd2d42525428465c90522337ec5a4b82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:59:30 user nova-compute[74934]: INFO nova.virt.block_device [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Booting with volume 57bf72fa-eafa-46f5-b4f3-37a469530bf3 at /dev/vda
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_brick.utils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e73bdc-f8ad-49de-9e61-3d1e9e6af672]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b607c-9165-400b-be23-5fb33e6f24b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2727c-6405-49c9-b1bd-b423386b5c00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[12532680-2be6-45d9-9a1c-2bcd87aa062d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:30 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:59:30 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f76aed-3bab-40fc-bd05-157def2e7c0e]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG os_brick.utils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:30 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating existing volume attachment record: aea49407-f8bd-40a2-b088-6dc2db70e84c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:59:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Successfully created port: 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Successfully updated port: 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquired lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-changed-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Refreshing instance network info cache due to event network-changed-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] Acquiring lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-189fb83f-cc15-4cc7-bd07-9ca956a2238d req-5197cab6-df45-4701-b74e-cc34772c7ba6 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-189fb83f-cc15-4cc7-bd07-9ca956a2238d req-5197cab6-df45-4701-b74e-cc34772c7ba6 service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-189fb83f-cc15-4cc7-bd07-9ca956a2238d req-5197cab6-df45-4701-b74e-cc34772c7ba6 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-189fb83f-cc15-4cc7-bd07-9ca956a2238d req-5197cab6-df45-4701-b74e-cc34772c7ba6 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.compute.manager [req-189fb83f-cc15-4cc7-bd07-9ca956a2238d req-5197cab6-df45-4701-b74e-cc34772c7ba6 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:32 user nova-compute[74934]: WARNING nova.compute.manager [req-189fb83f-cc15-4cc7-bd07-9ca956a2238d req-5197cab6-df45-4701-b74e-cc34772c7ba6 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Releasing lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance network_info: |[{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] Acquired lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Refreshing network info cache for port 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:33 user nova-compute[74934]: DEBUG nova.network.neutron [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updated VIF entry in instance network info cache for port 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:59:33 user nova-compute[74934]: DEBUG nova.network.neutron [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb373422-0e04-42d5-aaee-73ada4b88711 req-b96f7439-b6a4-40cf-ae4d-d5846fccb3f1 service nova] Releasing lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.compute.manager [req-c68fde39-2821-4a2a-86bd-c2d37430438e req-cc9060f9-f86e-4ac8-b9f4-bd57fc0918f9 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c68fde39-2821-4a2a-86bd-c2d37430438e req-cc9060f9-f86e-4ac8-b9f4-bd57fc0918f9 service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c68fde39-2821-4a2a-86bd-c2d37430438e req-cc9060f9-f86e-4ac8-b9f4-bd57fc0918f9 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c68fde39-2821-4a2a-86bd-c2d37430438e req-cc9060f9-f86e-4ac8-b9f4-bd57fc0918f9 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.compute.manager [req-c68fde39-2821-4a2a-86bd-c2d37430438e req-cc9060f9-f86e-4ac8-b9f4-bd57fc0918f9 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:34 user nova-compute[74934]: WARNING nova.compute.manager [req-c68fde39-2821-4a2a-86bd-c2d37430438e req-cc9060f9-f86e-4ac8-b9f4-bd57fc0918f9 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:59:34 user nova-compute[74934]: INFO nova.compute.claims [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Claim successful on node user
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:59:34 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance spawned successfully.
Nov 19 14:59:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e07adbbe-0ed0-4f1e-95cc-4c8f52e1a1a9 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.663s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.859s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:59:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:59:35 user nova-compute[74934]: INFO nova.virt.block_device [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Booting with volume-backed-image 010d533e-05ed-478e-9adb-00e830e2c77e at /dev/vda
Nov 19 14:59:35 user nova-compute[74934]: DEBUG nova.policy [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08d75edb533b4dfca6e9785c439df050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da5862e932d40a68f17b4e8bb77ef77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:59:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Successfully created port: 92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Successfully updated port: 92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-changed-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Refreshing instance network info cache due to event network-changed-92a12e86-cd82-472f-88ea-0d6c6e9556fc. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] Acquiring lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating instance_info_cache with network_info: [{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance network_info: |[{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] Acquired lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Refreshing network info cache for port 92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:59:37 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Creating image(s)
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Ensure instance console log exists: /opt/stack/data/nova/instances/b84f250c-ee76-451f-bf66-68e25842b7e8/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Start _get_guest_xml network_info=[{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'aea49407-f8bd-40a2-b088-6dc2db70e84c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b84f250c-ee76-451f-bf66-68e25842b7e8', 'attached_at': '', 'detached_at': '', 'volume_id': '57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'serial': '57bf72fa-eafa-46f5-b4f3-37a469530bf3'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:59:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:37 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:37 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:37 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:37 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[543b823d-28dc-44be-9001-b403957be465]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:59:37 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1306a4-fb92-4a23-8198-cd41b6783f6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3] added
Nov 19 14:59:37 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1829dec7-34ca-4632-a106-a7da7f58008f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d7f19-3415-4e55-9c6c-e1095b631f14]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWzhEYqR {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWzhEYqR" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396b411-7818-4627-afc3-966bb78aef1a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mWzhEYqR'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6976e03-59ce-4ef0-ad7c-864d791f39ca]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9144094a-d199-4715-a0b2-f912890d5cd3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:37 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:37 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:37 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:37 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:37 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:37 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updated VIF entry in instance network info cache for port 92a12e86-cd82-472f-88ea-0d6c6e9556fc. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating instance_info_cache with network_info: [{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e35a63fe-84be-429b-9176-783e721d591f req-cd384adc-1c0a-4991-b7ff-335899e5e07c service nova] Releasing lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387ac94-e373-4c95-b8f4-e00ff24f7556]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]
Nov 19 14:59:38 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65da43c-3a51-488e-930b-6918a04226bb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ee6e1a-e4da-4870-b180-795b5f9ddca0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:38 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:38 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:38 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 14:59:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:38 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:38 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:38 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 14:59:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7596c099-10d1-4e4b-a5bc-381735546aea]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:59:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26239373439343239', 'path': '/dev/sde'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373439343239', 'path': '/dev/sde'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696276764',display_name='tempest-ServerActionsTestOtherA-server-696276764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-696276764',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-lnfmhdyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=b84f250c-ee76-451f-bf66-68e25842b7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'pci_devices' on Instance uuid b84f250c-ee76-451f-bf66-68e25842b7e8 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:59:39 user nova-compute[74934]:   <uuid>b84f250c-ee76-451f-bf66-68e25842b7e8</uuid>
Nov 19 14:59:39 user nova-compute[74934]:   <name>instance-00000021</name>
Nov 19 14:59:39 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:59:39 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:59:39 user nova-compute[74934]:   <metadata>
Nov 19 14:59:39 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:59:39 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:59:39 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherA-server-696276764</nova:name>
Nov 19 14:59:39 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:59:37</nova:creationTime>
Nov 19 14:59:39 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:59:39 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:59:39 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:59:39 user nova-compute[74934]:       <nova:owner>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:user uuid="77319d6b70b24f22b39342f6955a8fef">tempest-ServerActionsTestOtherA-463456576-project-member</nova:user>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:project uuid="bd2d42525428465c90522337ec5a4b82">tempest-ServerActionsTestOtherA-463456576</nova:project>
Nov 19 14:59:39 user nova-compute[74934]:       </nova:owner>
Nov 19 14:59:39 user nova-compute[74934]:       <nova:ports>
Nov 19 14:59:39 user nova-compute[74934]:         <nova:port uuid="9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe">
Nov 19 14:59:39 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 14:59:39 user nova-compute[74934]:         </nova:port>
Nov 19 14:59:39 user nova-compute[74934]:       </nova:ports>
Nov 19 14:59:39 user nova-compute[74934]:     </nova:instance>
Nov 19 14:59:39 user nova-compute[74934]:   </metadata>
Nov 19 14:59:39 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:59:39 user nova-compute[74934]:     <system>
Nov 19 14:59:39 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:59:39 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:59:39 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:59:39 user nova-compute[74934]:       <entry name="serial">b84f250c-ee76-451f-bf66-68e25842b7e8</entry>
Nov 19 14:59:39 user nova-compute[74934]:       <entry name="uuid">b84f250c-ee76-451f-bf66-68e25842b7e8</entry>
Nov 19 14:59:39 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:59:39 user nova-compute[74934]:     </system>
Nov 19 14:59:39 user nova-compute[74934]:   </sysinfo>
Nov 19 14:59:39 user nova-compute[74934]:   <os>
Nov 19 14:59:39 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:59:39 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:59:39 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:59:39 user nova-compute[74934]:   </os>
Nov 19 14:59:39 user nova-compute[74934]:   <features>
Nov 19 14:59:39 user nova-compute[74934]:     <acpi/>
Nov 19 14:59:39 user nova-compute[74934]:     <apic/>
Nov 19 14:59:39 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:59:39 user nova-compute[74934]:   </features>
Nov 19 14:59:39 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:59:39 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:59:39 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:59:39 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:59:39 user nova-compute[74934]:   </clock>
Nov 19 14:59:39 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:59:39 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:59:39 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:59:39 user nova-compute[74934]:   </cpu>
Nov 19 14:59:39 user nova-compute[74934]:   <devices>
Nov 19 14:59:39 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:59:39 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:59:39 user nova-compute[74934]:       <source dev="/dev/sde"/>
Nov 19 14:59:39 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:59:39 user nova-compute[74934]:       <serial>57bf72fa-eafa-46f5-b4f3-37a469530bf3</serial>
Nov 19 14:59:39 user nova-compute[74934]:     </disk>
Nov 19 14:59:39 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:59:39 user nova-compute[74934]:       <mac address="fa:16:3e:46:c6:b9"/>
Nov 19 14:59:39 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:39 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:59:39 user nova-compute[74934]:       <target dev="tap9e3cf8bc-d4"/>
Nov 19 14:59:39 user nova-compute[74934]:     </interface>
Nov 19 14:59:39 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:59:39 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/b84f250c-ee76-451f-bf66-68e25842b7e8/console.log" append="off"/>
Nov 19 14:59:39 user nova-compute[74934]:     </serial>
Nov 19 14:59:39 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:59:39 user nova-compute[74934]:     <video>
Nov 19 14:59:39 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:39 user nova-compute[74934]:     </video>
Nov 19 14:59:39 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:59:39 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:59:39 user nova-compute[74934]:     </rng>
Nov 19 14:59:39 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:59:39 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:59:39 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:59:39 user nova-compute[74934]:     </memballoon>
Nov 19 14:59:39 user nova-compute[74934]:   </devices>
Nov 19 14:59:39 user nova-compute[74934]: </domain>
Nov 19 14:59:39 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696276764',display_name='tempest-ServerActionsTestOtherA-server-696276764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-696276764',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-lnfmhdyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=b84f250c-ee76-451f-bf66-68e25842b7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG os_vif [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b031c54-6f95-5a64-b17e-84541f777266', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e3cf8bc-d4, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e3cf8bc-d4, col_values=(('qos', UUID('79233f4f-e887-4256-9b79-8071be3d4158')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e3cf8bc-d4, col_values=(('external_ids', {'iface-id': '9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:c6:b9', 'vm-uuid': 'b84f250c-ee76-451f-bf66-68e25842b7e8'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:39 user nova-compute[74934]: INFO os_vif [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4')
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No VIF found with MAC fa:16:3e:46:c6:b9, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-81637337-5702-47a4-bf4f-5f19151f11d8 req-e1b29ac2-d7fb-453a-91f8-9793aa472c2e service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-81637337-5702-47a4-bf4f-5f19151f11d8 req-e1b29ac2-d7fb-453a-91f8-9793aa472c2e service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-81637337-5702-47a4-bf4f-5f19151f11d8 req-e1b29ac2-d7fb-453a-91f8-9793aa472c2e service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-81637337-5702-47a4-bf4f-5f19151f11d8 req-e1b29ac2-d7fb-453a-91f8-9793aa472c2e service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-81637337-5702-47a4-bf4f-5f19151f11d8 req-e1b29ac2-d7fb-453a-91f8-9793aa472c2e service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:40 user nova-compute[74934]: WARNING nova.compute.manager [req-81637337-5702-47a4-bf4f-5f19151f11d8 req-e1b29ac2-d7fb-453a-91f8-9793aa472c2e service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state building and task_state spawning.
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa77d7ca-6d52-4509-bb11-7c261ef7e74b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b437d27-90c4-4cf8-b02c-78e3b526a4d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5820194-4b17-4043-9834-bc652b311897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[815f0b80-3a45-4df4-9583-84d0cf4e6691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:41 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:59:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d373d4-828d-4ab6-8d0a-418347d323e3]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG os_brick.utils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:41 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating existing volume attachment record: 0ca310b5-2ef7-455c-bb38-20c7c5cc2dbf {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:59:42 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance spawned successfully.
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-8e75934c-b8ea-4b64-bf0d-d4028e5bdbb2 req-a644d22a-4075-4e85-a8ce-2b599b7ac2da service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8e75934c-b8ea-4b64-bf0d-d4028e5bdbb2 req-a644d22a-4075-4e85-a8ce-2b599b7ac2da service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8e75934c-b8ea-4b64-bf0d-d4028e5bdbb2 req-a644d22a-4075-4e85-a8ce-2b599b7ac2da service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8e75934c-b8ea-4b64-bf0d-d4028e5bdbb2 req-a644d22a-4075-4e85-a8ce-2b599b7ac2da service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-8e75934c-b8ea-4b64-bf0d-d4028e5bdbb2 req-a644d22a-4075-4e85-a8ce-2b599b7ac2da service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:42 user nova-compute[74934]: WARNING nova.compute.manager [req-8e75934c-b8ea-4b64-bf0d-d4028e5bdbb2 req-a644d22a-4075-4e85-a8ce-2b599b7ac2da service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state building and task_state spawning.
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:43 user nova-compute[74934]: INFO nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 19 14:59:43 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:59:43 user nova-compute[74934]: INFO nova.compute.manager [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Took 13.53 seconds to build instance.
Nov 19 14:59:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4fbf7847-2cb1-4110-9463-78143d0efa29 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.640s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:45 user nova-compute[74934]: INFO nova.compute.manager [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Terminating instance
Nov 19 14:59:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-b7089b18-df67-4cc1-b648-a9db9b43cc11 req-b4593c20-6c93-4bf0-9bc3-95dd7dc1d8ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b7089b18-df67-4cc1-b648-a9db9b43cc11 req-b4593c20-6c93-4bf0-9bc3-95dd7dc1d8ed service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b7089b18-df67-4cc1-b648-a9db9b43cc11 req-b4593c20-6c93-4bf0-9bc3-95dd7dc1d8ed service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b7089b18-df67-4cc1-b648-a9db9b43cc11 req-b4593c20-6c93-4bf0-9bc3-95dd7dc1d8ed service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-b7089b18-df67-4cc1-b648-a9db9b43cc11 req-b4593c20-6c93-4bf0-9bc3-95dd7dc1d8ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:45 user nova-compute[74934]: DEBUG nova.compute.manager [req-b7089b18-df67-4cc1-b648-a9db9b43cc11 req-b4593c20-6c93-4bf0-9bc3-95dd7dc1d8ed service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Instance destroyed successfully.
Nov 19 14:59:46 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lazy-loading 'resources' on Instance uuid 7a6dc86f-e21c-4789-9433-34c25d9bf56b {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-803844216',display_name='tempest-ServerStableDeviceRescueTest-server-803844216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-803844216',id=19,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUbox5HSED7xpC7HcwUxHh/0v35TaeuRy2gcdD681u/N7L38YKqkTpHVLzJoGUNAcIKZPP/OmcGQYj0Ngko9361NpsKRyRpRFAzbO082DLyeyxZ3E1zPTtP7eszn4HUXQ==',key_name='tempest-keypair-1912348231',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c990d55cb669477a9e76605b29869641',ramdisk_id='',reservation_id='r-8k3ev66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-183407110',owner_user_name='tempest-ServerStableDeviceRescueTest-183407110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='992c2896dd1540d3b8d85928c7125cdb',uuid=7a6dc86f-e21c-4789-9433-34c25d9bf56b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converting VIF {"id": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "address": "fa:16:3e:ac:cf:bf", "network": {"id": "c15f231a-d394-4000-9075-27e01ec715ae", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1362901750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c990d55cb669477a9e76605b29869641", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8a80afc-d1", "ovs_interfaceid": "d8a80afc-d141-4ca8-a0b3-b0374f579f17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG os_vif [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8a80afc-d1, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8bb4eda-ec0e-485b-a484-2bfa7545ff90) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: INFO os_vif [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:cf:bf,bridge_name='br-int',has_traffic_filtering=True,id=d8a80afc-d141-4ca8-a0b3-b0374f579f17,network=Network(c15f231a-d394-4000-9075-27e01ec715ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8a80afc-d1')
Nov 19 14:59:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Deleting instance files /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b_del
Nov 19 14:59:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Deletion of /opt/stack/data/nova/instances/7a6dc86f-e21c-4789-9433-34c25d9bf56b_del complete
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: INFO nova.compute.manager [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 19 14:59:46 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:47 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Took 0.86 seconds to deallocate network for instance.
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-e98de49f-c5fb-4a78-9353-ffe5d0285e8e req-571e0691-b82b-4003-b5f2-504ee2d9cc04 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-deleted-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:47 user nova-compute[74934]: INFO nova.compute.manager [req-e98de49f-c5fb-4a78-9353-ffe5d0285e8e req-571e0691-b82b-4003-b5f2-504ee2d9cc04 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Neutron deleted interface d8a80afc-d141-4ca8-a0b3-b0374f579f17; detaching it from the instance and deleting it from the info cache
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.network.neutron [req-e98de49f-c5fb-4a78-9353-ffe5d0285e8e req-571e0691-b82b-4003-b5f2-504ee2d9cc04 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-e98de49f-c5fb-4a78-9353-ffe5d0285e8e req-571e0691-b82b-4003-b5f2-504ee2d9cc04 service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Detach interface failed, port_id=d8a80afc-d141-4ca8-a0b3-b0374f579f17, reason: Instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:47 user nova-compute[74934]: WARNING nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state deleted and task_state None.
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:47 user nova-compute[74934]: WARNING nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state deleted and task_state None.
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:47 user nova-compute[74934]: WARNING nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state deleted and task_state None.
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:47 user nova-compute[74934]: WARNING nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-unplugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state deleted and task_state None.
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Acquiring lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] No waiting events found dispatching network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:47 user nova-compute[74934]: WARNING nova.compute.manager [req-06b9576d-3a1e-4d4e-b79b-48c7994bcf29 req-50381bcf-84e2-43cb-8bfd-553cbed8e79b service nova] [instance: 7a6dc86f-e21c-4789-9433-34c25d9bf56b] Received unexpected event network-vif-plugged-d8a80afc-d141-4ca8-a0b3-b0374f579f17 for instance with vm_state deleted and task_state None.
Nov 19 14:59:47 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.721s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:48 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Deleted allocations for instance 7a6dc86f-e21c-4789-9433-34c25d9bf56b
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5bf8928c-305a-4e93-854c-cc12585e40ed tempest-ServerStableDeviceRescueTest-183407110 tempest-ServerStableDeviceRescueTest-183407110-project-member] Lock "7a6dc86f-e21c-4789-9433-34c25d9bf56b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.077s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:59:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Creating image(s)
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Ensure instance console log exists: /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Start _get_guest_xml network_info=[{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '0ca310b5-2ef7-455c-bb38-20c7c5cc2dbf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '069f95a6-6e49-4054-baf6-7da3d23c0514', 'attached_at': '', 'detached_at': '', 'volume_id': '123f3d77-d1a9-4963-a249-9e1f6037a833', 'serial': '123f3d77-d1a9-4963-a249-9e1f6037a833'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:59:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:48 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:48 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 14:59:48 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d577bc3-9fa0-4dd5-b5e0-7843a6f49261]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 14:59:48 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bf010-08c0-4d7e-bf05-deab8b87d5ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833] added
Nov 19 14:59:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[704652a4-1436-4d6f-a272-dfb6a5fa60b6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c0c743-3d57-43b2-a36a-99d6c91db085]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbcsGmAJ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbcsGmAJ" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73afd3-2c1a-432f-ba2f-aa193fbe9616]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TbcsGmAJ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbed036-554e-43ac-886e-08945487ccea]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ee684-f610-4b62-8e93-977db70ce80a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:48 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:48 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:48 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 14:59:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:48 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:48 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:48 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 14:59:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --login" returned: 0 in 0.152s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[02839475-f8e3-4189-b39f-f1b07c16e8e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260]
Nov 19 14:59:48 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260] successful.
Nov 19 14:59:48 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5756f5c-fbf5-4f1e-8a64-f6ca00722aa3]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14728f-cc9c-41c7-85d4-a68a4c736141]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 14:59:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 14:59:49 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 14:59:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefaf36-8bad-4536-bd48-614aac5cc36b]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 14:59:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23437356231353138', 'path': '/dev/sdf'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437356231353138', 'path': '/dev/sdf'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1041188902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1041188902',id=34,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-5rhaa0c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:36Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=069f95a6-6e49-4054-baf6-7da3d23c0514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'pci_devices' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:59:50 user nova-compute[74934]:   <uuid>069f95a6-6e49-4054-baf6-7da3d23c0514</uuid>
Nov 19 14:59:50 user nova-compute[74934]:   <name>instance-00000022</name>
Nov 19 14:59:50 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:59:50 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:59:50 user nova-compute[74934]:   <metadata>
Nov 19 14:59:50 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:59:50 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:59:50 user nova-compute[74934]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1041188902</nova:name>
Nov 19 14:59:50 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:59:48</nova:creationTime>
Nov 19 14:59:50 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:59:50 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:59:50 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:59:50 user nova-compute[74934]:       <nova:owner>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:user uuid="08d75edb533b4dfca6e9785c439df050">tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member</nova:user>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:project uuid="0da5862e932d40a68f17b4e8bb77ef77">tempest-ServerBootFromVolumeStableRescueTest-1047020547</nova:project>
Nov 19 14:59:50 user nova-compute[74934]:       </nova:owner>
Nov 19 14:59:50 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:59:50 user nova-compute[74934]:       <nova:ports>
Nov 19 14:59:50 user nova-compute[74934]:         <nova:port uuid="92a12e86-cd82-472f-88ea-0d6c6e9556fc">
Nov 19 14:59:50 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 14:59:50 user nova-compute[74934]:         </nova:port>
Nov 19 14:59:50 user nova-compute[74934]:       </nova:ports>
Nov 19 14:59:50 user nova-compute[74934]:     </nova:instance>
Nov 19 14:59:50 user nova-compute[74934]:   </metadata>
Nov 19 14:59:50 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:59:50 user nova-compute[74934]:     <system>
Nov 19 14:59:50 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:59:50 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:59:50 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:59:50 user nova-compute[74934]:       <entry name="serial">069f95a6-6e49-4054-baf6-7da3d23c0514</entry>
Nov 19 14:59:50 user nova-compute[74934]:       <entry name="uuid">069f95a6-6e49-4054-baf6-7da3d23c0514</entry>
Nov 19 14:59:50 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:59:50 user nova-compute[74934]:     </system>
Nov 19 14:59:50 user nova-compute[74934]:   </sysinfo>
Nov 19 14:59:50 user nova-compute[74934]:   <os>
Nov 19 14:59:50 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:59:50 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:59:50 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:59:50 user nova-compute[74934]:   </os>
Nov 19 14:59:50 user nova-compute[74934]:   <features>
Nov 19 14:59:50 user nova-compute[74934]:     <acpi/>
Nov 19 14:59:50 user nova-compute[74934]:     <apic/>
Nov 19 14:59:50 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:59:50 user nova-compute[74934]:   </features>
Nov 19 14:59:50 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:59:50 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:59:50 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:59:50 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:59:50 user nova-compute[74934]:   </clock>
Nov 19 14:59:50 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:59:50 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:59:50 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:59:50 user nova-compute[74934]:   </cpu>
Nov 19 14:59:50 user nova-compute[74934]:   <devices>
Nov 19 14:59:50 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 14:59:50 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 14:59:50 user nova-compute[74934]:       <source dev="/dev/sdf"/>
Nov 19 14:59:50 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:59:50 user nova-compute[74934]:       <serial>123f3d77-d1a9-4963-a249-9e1f6037a833</serial>
Nov 19 14:59:50 user nova-compute[74934]:     </disk>
Nov 19 14:59:50 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:59:50 user nova-compute[74934]:       <mac address="fa:16:3e:56:07:fd"/>
Nov 19 14:59:50 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:50 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:59:50 user nova-compute[74934]:       <target dev="tap92a12e86-cd"/>
Nov 19 14:59:50 user nova-compute[74934]:     </interface>
Nov 19 14:59:50 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:59:50 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/console.log" append="off"/>
Nov 19 14:59:50 user nova-compute[74934]:     </serial>
Nov 19 14:59:50 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:59:50 user nova-compute[74934]:     <video>
Nov 19 14:59:50 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:50 user nova-compute[74934]:     </video>
Nov 19 14:59:50 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:59:50 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:59:50 user nova-compute[74934]:     </rng>
Nov 19 14:59:50 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:59:50 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:59:50 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:59:50 user nova-compute[74934]:     </memballoon>
Nov 19 14:59:50 user nova-compute[74934]:   </devices>
Nov 19 14:59:50 user nova-compute[74934]: </domain>
Nov 19 14:59:50 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1041188902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1041188902',id=34,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-5rhaa0c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:36Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=069f95a6-6e49-4054-baf6-7da3d23c0514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG os_vif [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba267aa2-8baa-5fb1-9f5c-001f1a3d08e7', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92a12e86-cd, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92a12e86-cd, col_values=(('qos', UUID('32cf7a13-d885-4e25-8ccd-c3c4d647bcfb')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92a12e86-cd, col_values=(('external_ids', {'iface-id': '92a12e86-cd82-472f-88ea-0d6c6e9556fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:07:fd', 'vm-uuid': '069f95a6-6e49-4054-baf6-7da3d23c0514'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:50 user nova-compute[74934]: INFO os_vif [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd')
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No VIF found with MAC fa:16:3e:56:07:fd, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c9085859-2bfc-4de6-a6a8-072bd4ef2a85 req-e0368c4a-5865-4aa6-afa8-9ac55e1e958c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c9085859-2bfc-4de6-a6a8-072bd4ef2a85 req-e0368c4a-5865-4aa6-afa8-9ac55e1e958c service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c9085859-2bfc-4de6-a6a8-072bd4ef2a85 req-e0368c4a-5865-4aa6-afa8-9ac55e1e958c service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c9085859-2bfc-4de6-a6a8-072bd4ef2a85 req-e0368c4a-5865-4aa6-afa8-9ac55e1e958c service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c9085859-2bfc-4de6-a6a8-072bd4ef2a85 req-e0368c4a-5865-4aa6-afa8-9ac55e1e958c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:51 user nova-compute[74934]: WARNING nova.compute.manager [req-c9085859-2bfc-4de6-a6a8-072bd4ef2a85 req-e0368c4a-5865-4aa6-afa8-9ac55e1e958c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state building and task_state spawning.
Nov 19 14:59:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 14:59:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance spawned successfully.
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 14:59:53 user nova-compute[74934]: INFO nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-a883fa0d-ad49-460d-944f-eb1c9df65f09 req-f324409d-3738-4041-adf5-e397c9a71620 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a883fa0d-ad49-460d-944f-eb1c9df65f09 req-f324409d-3738-4041-adf5-e397c9a71620 service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a883fa0d-ad49-460d-944f-eb1c9df65f09 req-f324409d-3738-4041-adf5-e397c9a71620 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a883fa0d-ad49-460d-944f-eb1c9df65f09 req-f324409d-3738-4041-adf5-e397c9a71620 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-a883fa0d-ad49-460d-944f-eb1c9df65f09 req-f324409d-3738-4041-adf5-e397c9a71620 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 14:59:53 user nova-compute[74934]: WARNING nova.compute.manager [req-a883fa0d-ad49-460d-944f-eb1c9df65f09 req-f324409d-3738-4041-adf5-e397c9a71620 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state building and task_state spawning.
Nov 19 14:59:53 user nova-compute[74934]: INFO nova.compute.manager [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Took 19.39 seconds to build instance.
Nov 19 14:59:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f069538-f52e-4feb-a24e-62aeae525f3d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.539s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 14:59:55 user nova-compute[74934]: INFO nova.compute.claims [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Claim successful on node user
Nov 19 14:59:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 14:59:55 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.network.neutron [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 14:59:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.policy [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124c5ebfa08e42e49e2e9d244103a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8926ff675c045458069f7b4e1ebc656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 14:59:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Creating image(s)
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "/opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.233s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.224s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk 1073741824" returned: 0 in 0.052s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:56 user nova-compute[74934]: DEBUG nova.network.neutron [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Successfully created port: e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Cannot resize image /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Ensure instance console log exists: /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:57 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.neutron [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Successfully updated port: e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquired lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.neutron [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-changed-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Refreshing instance network info cache due to event network-changed-e577961b-b83a-4b35-9599-a725cbb19690. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] Acquiring lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.neutron [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.neutron [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updating instance_info_cache with network_info: [{"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Releasing lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Instance network_info: |[{"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] Acquired lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.neutron [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Refreshing network info cache for port e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Start _get_guest_xml network_info=[{"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:58 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-721035766',display_name='tempest-AttachVolumeNegativeTest-server-721035766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-721035766',id=35,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGROgSNYoNAznrrpFYotWW6dQA8qWdd7Y5Z5gNR6PKUOsMEg5ZKnlKa8DfwjOJ3OMTOI6itoYS8JlQ/+Gw/eVRr64pxs3uo8E9lZdDVidLH29tzRTW6MIoDh7Ojx6I+SIA==',key_name='tempest-keypair-509303060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-h5f3evy5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=98c746cb-1a7a-4a76-b497-e803dfa7be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:58 user nova-compute[74934]: DEBUG nova.objects.instance [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'pci_devices' on Instance uuid 98c746cb-1a7a-4a76-b497-e803dfa7be71 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] End _get_guest_xml xml=<domain type="kvm">
Nov 19 14:59:59 user nova-compute[74934]:   <uuid>98c746cb-1a7a-4a76-b497-e803dfa7be71</uuid>
Nov 19 14:59:59 user nova-compute[74934]:   <name>instance-00000023</name>
Nov 19 14:59:59 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 14:59:59 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 14:59:59 user nova-compute[74934]:   <metadata>
Nov 19 14:59:59 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 14:59:59 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 14:59:59 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeNegativeTest-server-721035766</nova:name>
Nov 19 14:59:59 user nova-compute[74934]:       <nova:creationTime>2023-11-19 14:59:58</nova:creationTime>
Nov 19 14:59:59 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 14:59:59 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 14:59:59 user nova-compute[74934]:       </nova:flavor>
Nov 19 14:59:59 user nova-compute[74934]:       <nova:owner>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:user uuid="124c5ebfa08e42e49e2e9d244103a1f4">tempest-AttachVolumeNegativeTest-661612303-project-member</nova:user>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:project uuid="a8926ff675c045458069f7b4e1ebc656">tempest-AttachVolumeNegativeTest-661612303</nova:project>
Nov 19 14:59:59 user nova-compute[74934]:       </nova:owner>
Nov 19 14:59:59 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 14:59:59 user nova-compute[74934]:       <nova:ports>
Nov 19 14:59:59 user nova-compute[74934]:         <nova:port uuid="e577961b-b83a-4b35-9599-a725cbb19690">
Nov 19 14:59:59 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 19 14:59:59 user nova-compute[74934]:         </nova:port>
Nov 19 14:59:59 user nova-compute[74934]:       </nova:ports>
Nov 19 14:59:59 user nova-compute[74934]:     </nova:instance>
Nov 19 14:59:59 user nova-compute[74934]:   </metadata>
Nov 19 14:59:59 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 14:59:59 user nova-compute[74934]:     <system>
Nov 19 14:59:59 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 14:59:59 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 14:59:59 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 14:59:59 user nova-compute[74934]:       <entry name="serial">98c746cb-1a7a-4a76-b497-e803dfa7be71</entry>
Nov 19 14:59:59 user nova-compute[74934]:       <entry name="uuid">98c746cb-1a7a-4a76-b497-e803dfa7be71</entry>
Nov 19 14:59:59 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 14:59:59 user nova-compute[74934]:     </system>
Nov 19 14:59:59 user nova-compute[74934]:   </sysinfo>
Nov 19 14:59:59 user nova-compute[74934]:   <os>
Nov 19 14:59:59 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 14:59:59 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 14:59:59 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 14:59:59 user nova-compute[74934]:   </os>
Nov 19 14:59:59 user nova-compute[74934]:   <features>
Nov 19 14:59:59 user nova-compute[74934]:     <acpi/>
Nov 19 14:59:59 user nova-compute[74934]:     <apic/>
Nov 19 14:59:59 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 14:59:59 user nova-compute[74934]:   </features>
Nov 19 14:59:59 user nova-compute[74934]:   <clock offset="utc">
Nov 19 14:59:59 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 14:59:59 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 14:59:59 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 14:59:59 user nova-compute[74934]:   </clock>
Nov 19 14:59:59 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 14:59:59 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 14:59:59 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 14:59:59 user nova-compute[74934]:   </cpu>
Nov 19 14:59:59 user nova-compute[74934]:   <devices>
Nov 19 14:59:59 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 14:59:59 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 14:59:59 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk"/>
Nov 19 14:59:59 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 14:59:59 user nova-compute[74934]:     </disk>
Nov 19 14:59:59 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 14:59:59 user nova-compute[74934]:       <mac address="fa:16:3e:ed:c9:4f"/>
Nov 19 14:59:59 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:59 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 14:59:59 user nova-compute[74934]:       <target dev="tape577961b-b8"/>
Nov 19 14:59:59 user nova-compute[74934]:     </interface>
Nov 19 14:59:59 user nova-compute[74934]:     <serial type="pty">
Nov 19 14:59:59 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/console.log" append="off"/>
Nov 19 14:59:59 user nova-compute[74934]:     </serial>
Nov 19 14:59:59 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 14:59:59 user nova-compute[74934]:     <video>
Nov 19 14:59:59 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 14:59:59 user nova-compute[74934]:     </video>
Nov 19 14:59:59 user nova-compute[74934]:     <rng model="virtio">
Nov 19 14:59:59 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 14:59:59 user nova-compute[74934]:     </rng>
Nov 19 14:59:59 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 14:59:59 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 14:59:59 user nova-compute[74934]:       <stats period="10"/>
Nov 19 14:59:59 user nova-compute[74934]:     </memballoon>
Nov 19 14:59:59 user nova-compute[74934]:   </devices>
Nov 19 14:59:59 user nova-compute[74934]: </domain>
Nov 19 14:59:59 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-721035766',display_name='tempest-AttachVolumeNegativeTest-server-721035766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-721035766',id=35,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGROgSNYoNAznrrpFYotWW6dQA8qWdd7Y5Z5gNR6PKUOsMEg5ZKnlKa8DfwjOJ3OMTOI6itoYS8JlQ/+Gw/eVRr64pxs3uo8E9lZdDVidLH29tzRTW6MIoDh7Ojx6I+SIA==',key_name='tempest-keypair-509303060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-h5f3evy5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=98c746cb-1a7a-4a76-b497-e803dfa7be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_vif [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '529773e2-926b-518a-88ec-6d34797aef8d', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape577961b-b8, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape577961b-b8, col_values=(('qos', UUID('17dce486-53e3-4fed-9056-b14145da31ad')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape577961b-b8, col_values=(('external_ids', {'iface-id': 'e577961b-b83a-4b35-9599-a725cbb19690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:c9:4f', 'vm-uuid': '98c746cb-1a7a-4a76-b497-e803dfa7be71'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 14:59:59 user nova-compute[74934]: INFO os_vif [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8')
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:ed:c9:4f, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'flavor' on Instance uuid 3c1e28e7-4514-4443-b365-da62a85bbc0f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updated VIF entry in instance network info cache for port e577961b-b83a-4b35-9599-a725cbb19690. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updating instance_info_cache with network_info: [{"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dda6b582-8a70-4051-a278-83d4ec85de37 req-6968e759-9a90-4d31-adcf-fb465893490e service nova] Releasing lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 14:59:59 user nova-compute[74934]: INFO nova.compute.manager [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Attaching volume 278aeff5-5107-476f-8471-9c0bcf58954b to /dev/vdb
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_brick.utils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c82a436-86bf-4cc3-b041-1452d6de63bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe84c12-47f0-4269-b070-f0227f35d700]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8884a-8c97-40d2-bf5a-5603f893209d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e360316-5712-4920-b8cf-178c06669b94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 14:59:59 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47622e-b201-46cf-8b00-b25f8b9f05aa]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG os_brick.utils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating existing volume attachment record: da45bda9-bd97-40b9-8dd2-350bc2a87c50 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 14:59:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-d905e8a9-9b6d-4660-9f90-b2d319abb02a req-f46a9648-592b-46c6-99bb-9092b38dd12f service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d905e8a9-9b6d-4660-9f90-b2d319abb02a req-f46a9648-592b-46c6-99bb-9092b38dd12f service nova] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d905e8a9-9b6d-4660-9f90-b2d319abb02a req-f46a9648-592b-46c6-99bb-9092b38dd12f service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d905e8a9-9b6d-4660-9f90-b2d319abb02a req-f46a9648-592b-46c6-99bb-9092b38dd12f service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-d905e8a9-9b6d-4660-9f90-b2d319abb02a req-f46a9648-592b-46c6-99bb-9092b38dd12f service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] No waiting events found dispatching network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:00 user nova-compute[74934]: WARNING nova.compute.manager [req-d905e8a9-9b6d-4660-9f90-b2d319abb02a req-f46a9648-592b-46c6-99bb-9092b38dd12f service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received unexpected event network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 for instance with vm_state building and task_state spawning.
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:00:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Instance spawned successfully.
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-f7675491-94b9-4485-a967-4299ba977c72 req-6ac30517-f900-4f8c-a292-71421d2b30f9 service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f7675491-94b9-4485-a967-4299ba977c72 req-6ac30517-f900-4f8c-a292-71421d2b30f9 service nova] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f7675491-94b9-4485-a967-4299ba977c72 req-6ac30517-f900-4f8c-a292-71421d2b30f9 service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f7675491-94b9-4485-a967-4299ba977c72 req-6ac30517-f900-4f8c-a292-71421d2b30f9 service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-f7675491-94b9-4485-a967-4299ba977c72 req-6ac30517-f900-4f8c-a292-71421d2b30f9 service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] No waiting events found dispatching network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:02 user nova-compute[74934]: WARNING nova.compute.manager [req-f7675491-94b9-4485-a967-4299ba977c72 req-6ac30517-f900-4f8c-a292-71421d2b30f9 service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received unexpected event network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 for instance with vm_state building and task_state spawning.
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:00:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:03 user nova-compute[74934]: INFO nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:00:03 user nova-compute[74934]: INFO nova.compute.manager [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Took 7.81 seconds to build instance.
Nov 19 15:00:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-177b53d2-d68f-455b-9796-41a17b97fa7d tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.015s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:00:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7096MB free_disk=24.871841430664062GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Applying migration context for instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 as it has an incoming, in-progress migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc. Migration status is finished {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 19 15:00:03 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating resource usage from migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 3c1e28e7-4514-4443-b365-da62a85bbc0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fcdd2cd7-4a0d-4cf7-a12c-6919fe189202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:00:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:00:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:00:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:00:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:00:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating instance_info_cache with network_info: [{"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-f1546e24-c8ba-40b9-81f9-084ab10c9a31" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEYlGKBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:00:05 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:00:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:00:05 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:00:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:00:05 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f108db65-3b07-4c7d-81f9-50cc9a5c99bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:00:05 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df904224-a95a-4401-8d0c-99724f9d3f2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b] added
Nov 19 15:00:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc3c0c0-bef4-4475-ac04-eb03752facd7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[607c2841-1fe2-43af-b818-0d539d7d039a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FEYlGKBz {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FEYlGKBz" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d7c51-1768-493b-abd3-d19dbf647c7a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FEYlGKBz'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f1a8fc-fca4-4b28-aa15-c23d15aa43fb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6878d55e-8c07-4dca-bd79-6967b9621ee0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef716fc4-78ba-4a4d-98d6-3154beee1d2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260]
Nov 19 15:00:06 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260] successful.
Nov 19 15:00:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bfa777-ceae-4c81-bd88-15e24d35752e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd18bb4-76bd-4bf6-8756-5345cb644b3a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:00:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:00:06 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:00:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[820b037b-958d-47a6-b68a-af54025f8b76]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:00:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEYlGKBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23734326566333935', 'path': '/dev/sdg'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734326566333935', 'path': '/dev/sdg'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'flavor' on Instance uuid 3c1e28e7-4514-4443-b365-da62a85bbc0f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:00:07 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:00:07 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 15:00:07 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:00:07 user nova-compute[74934]:   <serial>278aeff5-5107-476f-8471-9c0bcf58954b</serial>
Nov 19 15:00:07 user nova-compute[74934]: </disk>
Nov 19 15:00:07 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] No VIF found with MAC fa:16:3e:e7:52:44, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:00:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ebeb037b-4dc9-47e4-baf1-9288628201b0 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.278s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing instance network info cache due to event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updated VIF entry in instance network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:00:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5046ac94-81da-43eb-9e8f-05db0b8e554f req-87e7a0b9-9fd2-4238-be2c-3690a0644efb service nova] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing instance network info cache due to event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updated VIF entry in instance network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-06129bed-1ba1-47e0-bf23-47ee2662c9de req-6a60ae54-63ef-4a5a-86d6-dc35215acc46 service nova] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:12 user nova-compute[74934]: INFO nova.compute.manager [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Rebooting instance
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:00:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:00:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:00:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:00:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:00:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-53f87bb9-dccf-4580-9972-7e345fd07cd0 req-a3132acb-b48a-41b7-98a0-b6dcf0b5cf7c service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-unplugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53f87bb9-dccf-4580-9972-7e345fd07cd0 req-a3132acb-b48a-41b7-98a0-b6dcf0b5cf7c service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53f87bb9-dccf-4580-9972-7e345fd07cd0 req-a3132acb-b48a-41b7-98a0-b6dcf0b5cf7c service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53f87bb9-dccf-4580-9972-7e345fd07cd0 req-a3132acb-b48a-41b7-98a0-b6dcf0b5cf7c service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-53f87bb9-dccf-4580-9972-7e345fd07cd0 req-a3132acb-b48a-41b7-98a0-b6dcf0b5cf7c service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-unplugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:15 user nova-compute[74934]: WARNING nova.compute.manager [req-53f87bb9-dccf-4580-9972-7e345fd07cd0 req-a3132acb-b48a-41b7-98a0-b6dcf0b5cf7c service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-unplugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state active and task_state reboot_started.
Nov 19 15:00:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance shutdown successfully.
Nov 19 15:00:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-c9bc735d-15d4-4e1c-9c42-33f82a246a18 req-97ef33b5-54cb-48bd-95fc-9bf4e1cebad3 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c9bc735d-15d4-4e1c-9c42-33f82a246a18 req-97ef33b5-54cb-48bd-95fc-9bf4e1cebad3 service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c9bc735d-15d4-4e1c-9c42-33f82a246a18 req-97ef33b5-54cb-48bd-95fc-9bf4e1cebad3 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c9bc735d-15d4-4e1c-9c42-33f82a246a18 req-97ef33b5-54cb-48bd-95fc-9bf4e1cebad3 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-c9bc735d-15d4-4e1c-9c42-33f82a246a18 req-97ef33b5-54cb-48bd-95fc-9bf4e1cebad3 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:17 user nova-compute[74934]: WARNING nova.compute.manager [req-c9bc735d-15d4-4e1c-9c42-33f82a246a18 req-97ef33b5-54cb-48bd-95fc-9bf4e1cebad3 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state active and task_state reboot_started.
Nov 19 15:00:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance running successfully.
Nov 19 15:00:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance soft rebooted successfully.
Nov 19 15:00:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:19 user nova-compute[74934]: WARNING nova.compute.manager [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state active and task_state reboot_started.
Nov 19 15:00:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:20 user nova-compute[74934]: WARNING nova.compute.manager [req-3d6cdf6e-447a-4501-bcc4-3aae46141943 req-bba2c287-789f-4de7-b0a3-b0468b6f7b65 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state active and task_state reboot_started.
Nov 19 15:00:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c4eab0d8-6a67-409e-865d-d1b2ebe9cffb tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.168s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:26 user nova-compute[74934]: INFO nova.compute.manager [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Unrescuing
Nov 19 15:00:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'flavor' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-03355117-0d4c-4696-9cea-0cbe6c09000c req-2dcc0a55-40da-4ed3-a0ab-d51daa832f04 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-03355117-0d4c-4696-9cea-0cbe6c09000c req-2dcc0a55-40da-4ed3-a0ab-d51daa832f04 service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-03355117-0d4c-4696-9cea-0cbe6c09000c req-2dcc0a55-40da-4ed3-a0ab-d51daa832f04 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-03355117-0d4c-4696-9cea-0cbe6c09000c req-2dcc0a55-40da-4ed3-a0ab-d51daa832f04 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-03355117-0d4c-4696-9cea-0cbe6c09000c req-2dcc0a55-40da-4ed3-a0ab-d51daa832f04 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:26 user nova-compute[74934]: WARNING nova.compute.manager [req-03355117-0d4c-4696-9cea-0cbe6c09000c req-2dcc0a55-40da-4ed3-a0ab-d51daa832f04 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:00:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance destroyed successfully.
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:28 user nova-compute[74934]: WARNING nova.compute.manager [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:00:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:28 user nova-compute[74934]: WARNING nova.compute.manager [req-7b3176a5-4151-49ef-a524-e1a2ab5e7771 req-d688a56f-277d-4692-b1a7-7c1175394ac9 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:00:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-979f79a2-b414-4bd7-a10f-21bddabf3fd7 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-1356f3ac-b4ce-45b0-9de9-6a47be5305c0 req-c3ba43c8-89b5-46c7-94d2-31596a39677c service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1356f3ac-b4ce-45b0-9de9-6a47be5305c0 req-c3ba43c8-89b5-46c7-94d2-31596a39677c service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1356f3ac-b4ce-45b0-9de9-6a47be5305c0 req-c3ba43c8-89b5-46c7-94d2-31596a39677c service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1356f3ac-b4ce-45b0-9de9-6a47be5305c0 req-c3ba43c8-89b5-46c7-94d2-31596a39677c service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:30 user nova-compute[74934]: DEBUG nova.compute.manager [req-1356f3ac-b4ce-45b0-9de9-6a47be5305c0 req-c3ba43c8-89b5-46c7-94d2-31596a39677c service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:00:30 user nova-compute[74934]: WARNING nova.compute.manager [req-1356f3ac-b4ce-45b0-9de9-6a47be5305c0 req-c3ba43c8-89b5-46c7-94d2-31596a39677c service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state active and task_state None.
Nov 19 15:00:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:54 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquired lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'info_cache' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Releasing lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:00:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance destroyed successfully.
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'resources' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG os_vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e5537c-70, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6360abd8-62a5-41de-bd65-9bf09a0d9d9b) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:00:59 user nova-compute[74934]: INFO os_vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70')
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start _get_guest_xml network_info=[{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'numa_topology' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:00:59 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:00:59 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:00:59 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'pci_devices' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:01:00 user nova-compute[74934]:   <uuid>32eaf46a-1013-456e-9c2c-9f8805a53e20</uuid>
Nov 19 15:01:00 user nova-compute[74934]:   <name>instance-00000014</name>
Nov 19 15:01:00 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:01:00 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:01:00 user nova-compute[74934]:   <metadata>
Nov 19 15:01:00 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:01:00 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:01:00 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeTestJSON-server-2078832358</nova:name>
Nov 19 15:01:00 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:00:59</nova:creationTime>
Nov 19 15:01:00 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:01:00 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:01:00 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:01:00 user nova-compute[74934]:       <nova:owner>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:user uuid="eda5707b8cd7412098e9d0b3e4bdc536">tempest-AttachVolumeTestJSON-980904147-project-member</nova:user>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:project uuid="cd008f473dc744a9bc9f1ebc2f4cb95d">tempest-AttachVolumeTestJSON-980904147</nova:project>
Nov 19 15:01:00 user nova-compute[74934]:       </nova:owner>
Nov 19 15:01:00 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:01:00 user nova-compute[74934]:       <nova:ports>
Nov 19 15:01:00 user nova-compute[74934]:         <nova:port uuid="f4e5537c-702b-445b-a266-44da04a6747d">
Nov 19 15:01:00 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 15:01:00 user nova-compute[74934]:         </nova:port>
Nov 19 15:01:00 user nova-compute[74934]:       </nova:ports>
Nov 19 15:01:00 user nova-compute[74934]:     </nova:instance>
Nov 19 15:01:00 user nova-compute[74934]:   </metadata>
Nov 19 15:01:00 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:01:00 user nova-compute[74934]:     <system>
Nov 19 15:01:00 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:01:00 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:01:00 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:01:00 user nova-compute[74934]:       <entry name="serial">32eaf46a-1013-456e-9c2c-9f8805a53e20</entry>
Nov 19 15:01:00 user nova-compute[74934]:       <entry name="uuid">32eaf46a-1013-456e-9c2c-9f8805a53e20</entry>
Nov 19 15:01:00 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:01:00 user nova-compute[74934]:     </system>
Nov 19 15:01:00 user nova-compute[74934]:   </sysinfo>
Nov 19 15:01:00 user nova-compute[74934]:   <os>
Nov 19 15:01:00 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:01:00 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:01:00 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:01:00 user nova-compute[74934]:   </os>
Nov 19 15:01:00 user nova-compute[74934]:   <features>
Nov 19 15:01:00 user nova-compute[74934]:     <acpi/>
Nov 19 15:01:00 user nova-compute[74934]:     <apic/>
Nov 19 15:01:00 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:01:00 user nova-compute[74934]:   </features>
Nov 19 15:01:00 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:01:00 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:01:00 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:01:00 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:01:00 user nova-compute[74934]:   </clock>
Nov 19 15:01:00 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:01:00 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:01:00 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:01:00 user nova-compute[74934]:   </cpu>
Nov 19 15:01:00 user nova-compute[74934]:   <devices>
Nov 19 15:01:00 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:01:00 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:01:00 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk"/>
Nov 19 15:01:00 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:01:00 user nova-compute[74934]:     </disk>
Nov 19 15:01:00 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:01:00 user nova-compute[74934]:       <mac address="fa:16:3e:81:ed:9b"/>
Nov 19 15:01:00 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:00 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:01:00 user nova-compute[74934]:       <target dev="tapf4e5537c-70"/>
Nov 19 15:01:00 user nova-compute[74934]:     </interface>
Nov 19 15:01:00 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:01:00 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/console.log" append="off"/>
Nov 19 15:01:00 user nova-compute[74934]:     </serial>
Nov 19 15:01:00 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:01:00 user nova-compute[74934]:     <video>
Nov 19 15:01:00 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:00 user nova-compute[74934]:     </video>
Nov 19 15:01:00 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:01:00 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:01:00 user nova-compute[74934]:     </rng>
Nov 19 15:01:00 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:01:00 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:01:00 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:01:00 user nova-compute[74934]:     </memballoon>
Nov 19 15:01:00 user nova-compute[74934]:   </devices>
Nov 19 15:01:00 user nova-compute[74934]: </domain>
Nov 19 15:01:00 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Cannot resize image /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'migration_context' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.objects.base [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Object Instance<32eaf46a-1013-456e-9c2c-9f8805a53e20> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG os_vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f63473bc-7bae-5ec8-8a25-927e6e4e81e0', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e5537c-70, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4e5537c-70, col_values=(('qos', UUID('f0f70efe-2332-495c-8f86-4e48c61f71d7')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4e5537c-70, col_values=(('external_ids', {'iface-id': 'f4e5537c-702b-445b-a266-44da04a6747d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ed:9b', 'vm-uuid': '32eaf46a-1013-456e-9c2c-9f8805a53e20'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:00 user nova-compute[74934]: INFO os_vif [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70')
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Port 6f242ee2-4b9e-4d39-9534-7cf20e355413 binding to destination host user is already ACTIVE {{(pid=74934) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Creating tmpfile /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/tmpclve8fwn to verify with other compute node that the instance is on the same shared storage. {{(pid=74934) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-9e45b444-74e9-43f5-9ff1-e426fad245ca req-a670a682-0529-4772-85ba-1b3be36c3bc6 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9e45b444-74e9-43f5-9ff1-e426fad245ca req-a670a682-0529-4772-85ba-1b3be36c3bc6 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9e45b444-74e9-43f5-9ff1-e426fad245ca req-a670a682-0529-4772-85ba-1b3be36c3bc6 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9e45b444-74e9-43f5-9ff1-e426fad245ca req-a670a682-0529-4772-85ba-1b3be36c3bc6 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-9e45b444-74e9-43f5-9ff1-e426fad245ca req-a670a682-0529-4772-85ba-1b3be36c3bc6 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:02 user nova-compute[74934]: WARNING nova.compute.manager [req-9e45b444-74e9-43f5-9ff1-e426fad245ca req-a670a682-0529-4772-85ba-1b3be36c3bc6 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state resized and task_state resize_reverting.
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance destroyed successfully.
Nov 19 15:01:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'resources' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:59:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f242ee2-4b, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcf34645-59e0-4f9c-aa2e-8effb71adb9a) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:03 user nova-compute[74934]: INFO os_vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b')
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:03 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fafa0d-47ea-4b16-82d0-43940cb9aaa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:01:03 user nova-compute[74934]: No targets found.
Nov 19 15:01:03 user nova-compute[74934]: iSNS:
Nov 19 15:01:03 user nova-compute[74934]: No targets found.
Nov 19 15:01:03 user nova-compute[74934]: STATIC:
Nov 19 15:01:03 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:01:03 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:03 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:03 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 15:01:03 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:03 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:03 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:01:03 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:03 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:03 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b
Nov 19 15:01:03 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:03 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:03 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:01:03 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:03 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:03 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 15:01:03 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:03 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:03 user nova-compute[74934]: FIRMWARE:
Nov 19 15:01:03 user nova-compute[74934]: No targets found.
Nov 19 15:01:03 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:01:03 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:01:03 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[60747e1f-4574-4b8e-aa26-295a298122f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a1f53f-ee32-466a-b220-051ec3ffc204]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:03 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:03 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:03 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c45bf6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bf5fd9-030a-462c-aad6-2f40aee1b102]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f8a32-ce77-4cfb-a572-f42d5582f9a6]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf385f3f-8dbe-4648-9ccf-63808a546565]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[212d1b2e-7179-4801-91ee-177a5d60f61b]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fab1a8b-8feb-4923-b6b1-bb2bc43f9ad9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4ef78-40d2-44bb-a5fd-32140bf77cfc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]
Nov 19 15:01:03 user nova-compute[74934]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.
Nov 19 15:01:03 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbebbbd-5ae1-441e-8793-155af5c8d29e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== disconnect_volume: return (403ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:05 user nova-compute[74934]: WARNING nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state resized and task_state resize_reverting.
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:05 user nova-compute[74934]: WARNING nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state stopped and task_state powering-on.
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:05 user nova-compute[74934]: WARNING nova.compute.manager [req-cb5dba27-7d46-4c1d-971e-13d6b1006213 req-9904a288-62b9-4b15-9f35-2ef717c4cec8 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state stopped and task_state powering-on.
Nov 19 15:01:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance rebooted successfully.
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b8e51c4d-bd67-4eeb-b777-28b8bf0ed103 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:01:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6739MB free_disk=24.831661224365234GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Applying migration context for instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 as it has an incoming, in-progress migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc. Migration status is reverting {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 19 15:01:05 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating resource usage from migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 3c1e28e7-4514-4443-b365-da62a85bbc0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance fcdd2cd7-4a0d-4cf7-a12c-6919fe189202 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.797s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.objects.instance [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'migration_context' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.objects.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Object Instance<e7afb3a2-f158-4399-9fdb-82cdb44362e5> lazy-loaded attributes: resources,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:06 user nova-compute[74934]: INFO nova.compute.manager [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Terminating instance
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-b67ea728-2a55-48f1-8769-6da516c473b5 req-fd129e7e-f4ef-4d70-80e3-26315dd2ad25 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-vif-unplugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b67ea728-2a55-48f1-8769-6da516c473b5 req-fd129e7e-f4ef-4d70-80e3-26315dd2ad25 service nova] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b67ea728-2a55-48f1-8769-6da516c473b5 req-fd129e7e-f4ef-4d70-80e3-26315dd2ad25 service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b67ea728-2a55-48f1-8769-6da516c473b5 req-fd129e7e-f4ef-4d70-80e3-26315dd2ad25 service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-b67ea728-2a55-48f1-8769-6da516c473b5 req-fd129e7e-f4ef-4d70-80e3-26315dd2ad25 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] No waiting events found dispatching network-vif-unplugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-b67ea728-2a55-48f1-8769-6da516c473b5 req-fd129e7e-f4ef-4d70-80e3-26315dd2ad25 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-vif-unplugged-ec2bdd22-883d-4b84-8429-6196a203ae3e for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.888s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Instance destroyed successfully.
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lazy-loading 'resources' on Instance uuid fcdd2cd7-4a0d-4cf7-a12c-6919fe189202 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-805686881',display_name='tempest-VolumesActionsTest-instance-805686881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-805686881',id=32,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8be92c125fd34bef8e55fa83ef3d5f61',ramdisk_id='',reservation_id='r-4yyp8d3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1012691079',owner_user_name='tempest-VolumesActionsTest-1012691079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:59:22Z,user_data=None,user_id='e87a983281b3497781f13b9e3aafa55a',uuid=fcdd2cd7-4a0d-4cf7-a12c-6919fe189202,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converting VIF {"id": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "address": "fa:16:3e:83:d5:7b", "network": {"id": "51968e57-058b-47e2-95ae-341f34ff0fff", "bridge": "br-int", "label": "tempest-VolumesActionsTest-925084930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8be92c125fd34bef8e55fa83ef3d5f61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec2bdd22-88", "ovs_interfaceid": "ec2bdd22-883d-4b84-8429-6196a203ae3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG os_vif [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec2bdd22-88, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ec83bc3-4645-4aa3-bc9e-3a98cdb850f7) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:07 user nova-compute[74934]: INFO os_vif [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d5:7b,bridge_name='br-int',has_traffic_filtering=True,id=ec2bdd22-883d-4b84-8429-6196a203ae3e,network=Network(51968e57-058b-47e2-95ae-341f34ff0fff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec2bdd22-88')
Nov 19 15:01:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Deleting instance files /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202_del
Nov 19 15:01:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Deletion of /opt/stack/data/nova/instances/fcdd2cd7-4a0d-4cf7-a12c-6919fe189202_del complete
Nov 19 15:01:07 user nova-compute[74934]: INFO nova.compute.manager [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Swapping old allocation on dict_keys(['a6d80b64-40fb-4268-950b-1de97ecbab67']) held by migration 3ccf3a83-627c-4f83-9040-93c2d896dbdc for instance
Nov 19 15:01:07 user nova-compute[74934]: INFO nova.compute.manager [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Overwriting current allocation {'allocations': {'a6d80b64-40fb-4268-950b-1de97ecbab67': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 42}}, 'project_id': 'f186c71871084693a14881dce4328b46', 'user_id': '5935830106b34079a0d046897dac49ba', 'consumer_generation': 1} on consumer e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [{"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-32eaf46a-1013-456e-9c2c-9f8805a53e20" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:08 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Took 1.19 seconds to deallocate network for instance.
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2243bff3-1caa-40b3-b15a-fdd8e721bade]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dd1d5-7a5c-429b-904e-77596a409cc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0982233f-43a8-43c6-9871-7b78a929809b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd501bb-c712-4ff2-a76d-73007d278667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:01:08 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6bfaf-5ed5-4a1e-aeea-473b463090a3]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] Acquiring lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] No waiting events found dispatching network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:08 user nova-compute[74934]: WARNING nova.compute.manager [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received unexpected event network-vif-plugged-ec2bdd22-883d-4b84-8429-6196a203ae3e for instance with vm_state deleted and task_state None.
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-e79c5f9e-48ee-42b7-bf29-16f4c5bf8537 req-b7c120f7-c6f1-4164-b1ab-0d29aba61c94 service nova] [instance: fcdd2cd7-4a0d-4cf7-a12c-6919fe189202] Received event network-vif-deleted-ec2bdd22-883d-4b84-8429-6196a203ae3e {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:01:08 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:01:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:09 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Deleted allocations for instance fcdd2cd7-4a0d-4cf7-a12c-6919fe189202
Nov 19 15:01:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eed80b14-eb54-40fb-9fa8-6d59774fb2fe tempest-VolumesActionsTest-1012691079 tempest-VolumesActionsTest-1012691079-project-member] Lock "fcdd2cd7-4a0d-4cf7-a12c-6919fe189202" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:13 user nova-compute[74934]: INFO nova.compute.manager [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Terminating instance
Nov 19 15:01:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-a225e1d0-2923-44a7-b87e-fb50217715e1 req-6ecdeef4-9c92-4eaa-b67a-5351276450e7 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-unplugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a225e1d0-2923-44a7-b87e-fb50217715e1 req-6ecdeef4-9c92-4eaa-b67a-5351276450e7 service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a225e1d0-2923-44a7-b87e-fb50217715e1 req-6ecdeef4-9c92-4eaa-b67a-5351276450e7 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a225e1d0-2923-44a7-b87e-fb50217715e1 req-6ecdeef4-9c92-4eaa-b67a-5351276450e7 service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-a225e1d0-2923-44a7-b87e-fb50217715e1 req-6ecdeef4-9c92-4eaa-b67a-5351276450e7 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-unplugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:13 user nova-compute[74934]: DEBUG nova.compute.manager [req-a225e1d0-2923-44a7-b87e-fb50217715e1 req-6ecdeef4-9c92-4eaa-b67a-5351276450e7 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-unplugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Instance destroyed successfully.
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lazy-loading 'resources' on Instance uuid 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T14:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1000508196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1000508196',id=27,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF52SJ24KTJ0lnzWRi8r66UQRZE0Nq+Tz/L+Qyegc5jvTCJzi3W3/p965wktN/fjJMaQSnGmtvBKzOO5CEabYrkYGC+m202XNwa9G6Rxk3CQ159oDFocUHAeSc8FMuFrjQ==',key_name='tempest-keypair-993746842',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1735667909d4b3e94e6be7ba9a5ec7f',ramdisk_id='',reservation_id='r-3hfbw7e6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-884997441',owner_user_name='tempest-AttachVolumeShelveTestJSON-884997441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef44dc0981394f5fb42de977994f483d',uuid=60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converting VIF {"id": "ec88e767-be72-49c4-94a8-56d54e43569f", "address": "fa:16:3e:e1:01:04", "network": {"id": "b5e1e1e1-1451-475c-ace5-b0db490e2752", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1570524923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1735667909d4b3e94e6be7ba9a5ec7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec88e767-be", "ovs_interfaceid": "ec88e767-be72-49c4-94a8-56d54e43569f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_vif [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec88e767-be, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=510b39e0-5512-48dd-9ba5-ffb9d40df50e) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:14 user nova-compute[74934]: INFO os_vif [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:01:04,bridge_name='br-int',has_traffic_filtering=True,id=ec88e767-be72-49c4-94a8-56d54e43569f,network=Network(b5e1e1e1-1451-475c-ace5-b0db490e2752),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec88e767-be')
Nov 19 15:01:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Deleting instance files /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96_del
Nov 19 15:01:14 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Deletion of /opt/stack/data/nova/instances/60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96_del complete
Nov 19 15:01:14 user nova-compute[74934]: INFO nova.compute.manager [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Starting finish_revert_migration {{(pid=74934) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start _get_guest_xml network_info=[{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'attachment_id': '3d9b4d0d-fd07-4406-b0ca-9883bb07a285', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e7afb3a2-f158-4399-9fdb-82cdb44362e5', 'attached_at': '2023-11-19T15:01:14.000000', 'detached_at': '', 'volume_id': 'fce5e560-3383-4690-9255-8b47f3f361ac', 'serial': 'fce5e560-3383-4690-9255-8b47f3f361ac'}, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:01:14 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:14 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.objects.instance [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:14 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:14 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:14 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e7d319-c415-4efe-a908-d2237260292b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:01:14 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c3864-b9b7-4620-985a-0937825df159]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac] added
Nov 19 15:01:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82ff28-3159-4743-9c19-aa740cfbea4f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f3d667-5ebf-4634-bc4c-f61d0a501f0b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfmkcpXA {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfmkcpXA" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[39407c98-e7af-460f-bbac-cb2c031ae51b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfmkcpXA'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c7ef48-4160-4301-9643-8b2da3774477]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[277a1b1e-1b54-4e9d-afbb-6a38c7d6ac7e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:14 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:14 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:15 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Took 0.81 seconds to deallocate network for instance.
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-695506c2-1c62-4d28-b71a-a1cd919dbb6c req-4c31a613-24f8-4ea2-b96f-c1dbf4280372 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-deleted-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:15 user nova-compute[74934]: INFO nova.compute.manager [req-695506c2-1c62-4d28-b71a-a1cd919dbb6c req-4c31a613-24f8-4ea2-b96f-c1dbf4280372 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Neutron deleted interface ec88e767-be72-49c4-94a8-56d54e43569f; detaching it from the instance and deleting it from the info cache
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-695506c2-1c62-4d28-b71a-a1cd919dbb6c req-4c31a613-24f8-4ea2-b96f-c1dbf4280372 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08d4764-2f40-460a-a253-27abd3664eac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]
Nov 19 15:01:15 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.
Nov 19 15:01:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-695506c2-1c62-4d28-b71a-a1cd919dbb6c req-4c31a613-24f8-4ea2-b96f-c1dbf4280372 service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Detach interface failed, port_id=ec88e767-be72-49c4-94a8-56d54e43569f, reason: Instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e68b1b-1d84-4219-b913-f3c31beede88]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6d171-67bc-482c-8599-8e0931e18889]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:15 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a8bbb5-fb99-433a-acfe-0a4fb9dee008]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:15 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Deleted allocations for instance 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4ecd8244-7292-4bfb-85c7-daf941cfc512 tempest-AttachVolumeShelveTestJSON-884997441 tempest-AttachVolumeShelveTestJSON-884997441-project-member] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-ab49c140-805f-4674-b28f-6530858ce669 req-83175026-0c92-4a72-b3f5-120c2826618a service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ab49c140-805f-4674-b28f-6530858ce669 req-83175026-0c92-4a72-b3f5-120c2826618a service nova] Acquiring lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ab49c140-805f-4674-b28f-6530858ce669 req-83175026-0c92-4a72-b3f5-120c2826618a service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ab49c140-805f-4674-b28f-6530858ce669 req-83175026-0c92-4a72-b3f5-120c2826618a service nova] Lock "60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:15 user nova-compute[74934]: DEBUG nova.compute.manager [req-ab49c140-805f-4674-b28f-6530858ce669 req-83175026-0c92-4a72-b3f5-120c2826618a service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] No waiting events found dispatching network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:15 user nova-compute[74934]: WARNING nova.compute.manager [req-ab49c140-805f-4674-b28f-6530858ce669 req-83175026-0c92-4a72-b3f5-120c2826618a service nova] [instance: 60fa43cf-8fa4-4d81-8c2b-51e0dcce1a96] Received unexpected event network-vif-plugged-ec88e767-be72-49c4-94a8-56d54e43569f for instance with vm_state deleted and task_state None.
Nov 19 15:01:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26230303530356337', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230303530356337', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:01:16 user nova-compute[74934]:   <uuid>e7afb3a2-f158-4399-9fdb-82cdb44362e5</uuid>
Nov 19 15:01:16 user nova-compute[74934]:   <name>instance-00000019</name>
Nov 19 15:01:16 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:01:16 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:01:16 user nova-compute[74934]:   <metadata>
Nov 19 15:01:16 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:01:16 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:01:16 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherB-server-1516657562</nova:name>
Nov 19 15:01:16 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:01:14</nova:creationTime>
Nov 19 15:01:16 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:01:16 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:01:16 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:01:16 user nova-compute[74934]:       <nova:owner>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:user uuid="5935830106b34079a0d046897dac49ba">tempest-ServerActionsTestOtherB-868500136-project-member</nova:user>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:project uuid="f186c71871084693a14881dce4328b46">tempest-ServerActionsTestOtherB-868500136</nova:project>
Nov 19 15:01:16 user nova-compute[74934]:       </nova:owner>
Nov 19 15:01:16 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:01:16 user nova-compute[74934]:       <nova:ports>
Nov 19 15:01:16 user nova-compute[74934]:         <nova:port uuid="6f242ee2-4b9e-4d39-9534-7cf20e355413">
Nov 19 15:01:16 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 19 15:01:16 user nova-compute[74934]:         </nova:port>
Nov 19 15:01:16 user nova-compute[74934]:       </nova:ports>
Nov 19 15:01:16 user nova-compute[74934]:     </nova:instance>
Nov 19 15:01:16 user nova-compute[74934]:   </metadata>
Nov 19 15:01:16 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:01:16 user nova-compute[74934]:     <system>
Nov 19 15:01:16 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:01:16 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:01:16 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:01:16 user nova-compute[74934]:       <entry name="serial">e7afb3a2-f158-4399-9fdb-82cdb44362e5</entry>
Nov 19 15:01:16 user nova-compute[74934]:       <entry name="uuid">e7afb3a2-f158-4399-9fdb-82cdb44362e5</entry>
Nov 19 15:01:16 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:01:16 user nova-compute[74934]:     </system>
Nov 19 15:01:16 user nova-compute[74934]:   </sysinfo>
Nov 19 15:01:16 user nova-compute[74934]:   <os>
Nov 19 15:01:16 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:01:16 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:01:16 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:01:16 user nova-compute[74934]:   </os>
Nov 19 15:01:16 user nova-compute[74934]:   <features>
Nov 19 15:01:16 user nova-compute[74934]:     <acpi/>
Nov 19 15:01:16 user nova-compute[74934]:     <apic/>
Nov 19 15:01:16 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:01:16 user nova-compute[74934]:   </features>
Nov 19 15:01:16 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:01:16 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:01:16 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:01:16 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:01:16 user nova-compute[74934]:   </clock>
Nov 19 15:01:16 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:01:16 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:01:16 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:01:16 user nova-compute[74934]:   </cpu>
Nov 19 15:01:16 user nova-compute[74934]:   <devices>
Nov 19 15:01:16 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:01:16 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:01:16 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk"/>
Nov 19 15:01:16 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:01:16 user nova-compute[74934]:     </disk>
Nov 19 15:01:16 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:01:16 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:01:16 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 15:01:16 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 15:01:16 user nova-compute[74934]:       <serial>fce5e560-3383-4690-9255-8b47f3f361ac</serial>
Nov 19 15:01:16 user nova-compute[74934]:     </disk>
Nov 19 15:01:16 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:01:16 user nova-compute[74934]:       <mac address="fa:16:3e:84:28:56"/>
Nov 19 15:01:16 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:16 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:01:16 user nova-compute[74934]:       <target dev="tap6f242ee2-4b"/>
Nov 19 15:01:16 user nova-compute[74934]:     </interface>
Nov 19 15:01:16 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:01:16 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/console.log" append="off"/>
Nov 19 15:01:16 user nova-compute[74934]:     </serial>
Nov 19 15:01:16 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:01:16 user nova-compute[74934]:     <video>
Nov 19 15:01:16 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:16 user nova-compute[74934]:     </video>
Nov 19 15:01:16 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:01:16 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:01:16 user nova-compute[74934]:     </rng>
Nov 19 15:01:16 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:01:16 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:01:16 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:01:16 user nova-compute[74934]:     </memballoon>
Nov 19 15:01:16 user nova-compute[74934]:   </devices>
Nov 19 15:01:16 user nova-compute[74934]: </domain>
Nov 19 15:01:16 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG os_vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '692b2f3d-3784-55a0-8709-dbcc69b3499a', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f242ee2-4b, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f242ee2-4b, col_values=(('qos', UUID('6ce5aff7-8dec-4c55-9e23-9bbeb76733c9')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f242ee2-4b, col_values=(('external_ids', {'iface-id': '6f242ee2-4b9e-4d39-9534-7cf20e355413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:28:56', 'vm-uuid': 'e7afb3a2-f158-4399-9fdb-82cdb44362e5'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:16 user nova-compute[74934]: INFO os_vif [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b')
Nov 19 15:01:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-4f46f97e-a112-44f5-b5b6-3423f7e47adc req-484c8d03-5aad-4410-8068-302c123ded54 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f46f97e-a112-44f5-b5b6-3423f7e47adc req-484c8d03-5aad-4410-8068-302c123ded54 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f46f97e-a112-44f5-b5b6-3423f7e47adc req-484c8d03-5aad-4410-8068-302c123ded54 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f46f97e-a112-44f5-b5b6-3423f7e47adc req-484c8d03-5aad-4410-8068-302c123ded54 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-4f46f97e-a112-44f5-b5b6-3423f7e47adc req-484c8d03-5aad-4410-8068-302c123ded54 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:17 user nova-compute[74934]: WARNING nova.compute.manager [req-4f46f97e-a112-44f5-b5b6-3423f7e47adc req-484c8d03-5aad-4410-8068-302c123ded54 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state resized and task_state resize_reverting.
Nov 19 15:01:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7e413c5-1609-4f61-a309-cb6cfbf4b2fd req-0fb32a1c-4f66-4986-aac8-e644357185e2 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7e413c5-1609-4f61-a309-cb6cfbf4b2fd req-0fb32a1c-4f66-4986-aac8-e644357185e2 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7e413c5-1609-4f61-a309-cb6cfbf4b2fd req-0fb32a1c-4f66-4986-aac8-e644357185e2 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d7e413c5-1609-4f61-a309-cb6cfbf4b2fd req-0fb32a1c-4f66-4986-aac8-e644357185e2 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-d7e413c5-1609-4f61-a309-cb6cfbf4b2fd req-0fb32a1c-4f66-4986-aac8-e644357185e2 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:20 user nova-compute[74934]: WARNING nova.compute.manager [req-d7e413c5-1609-4f61-a309-cb6cfbf4b2fd req-0fb32a1c-4f66-4986-aac8-e644357185e2 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state resized and task_state resize_reverting.
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:01:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance running successfully.
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] finish_revert_migration finished successfully. {{(pid=74934) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-changed-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Refreshing instance network info cache due to event network-changed-bd3c8114-6b3f-4adf-820a-42f5197fc7b4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Refreshing network info cache for port bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:01:20 user nova-compute[74934]: INFO nova.compute.manager [None req-258fc8aa-9a45-4542-a312-5f2d9188e365 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance to original state: 'active'
Nov 19 15:01:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updated VIF entry in instance network info cache for port bd3c8114-6b3f-4adf-820a-42f5197fc7b4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-63eb74bc-1738-4257-b54a-71a6fba7050c req-b91f43c7-8270-4930-a2cd-0b491a5c28c7 service nova] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Stashing vm_state: active {{(pid=74934) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 19 15:01:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:01:21 user nova-compute[74934]: INFO nova.compute.claims [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Claim successful on node user
Nov 19 15:01:21 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating resource usage from migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-changed-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Refreshing instance network info cache due to event network-changed-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] Acquiring lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] Acquired lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Refreshing network info cache for port 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.595s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:22 user nova-compute[74934]: INFO nova.compute.manager [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Migrating
Nov 19 15:01:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updated VIF entry in instance network info cache for port 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef4137dd-3688-4b72-a8ed-7678b98148b2 req-fa90e0d5-68e8-4d1f-9fc7-002ba59c2f30 service nova] Releasing lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquired lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:22 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Releasing lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Starting migrate_disk_and_power_off {{(pid=74934) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG nova.compute.manager [req-d882f5ba-140e-4a3c-9a41-43a759805bf8 req-8480fe51-c235-435d-88db-4500f15d1487 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d882f5ba-140e-4a3c-9a41-43a759805bf8 req-8480fe51-c235-435d-88db-4500f15d1487 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d882f5ba-140e-4a3c-9a41-43a759805bf8 req-8480fe51-c235-435d-88db-4500f15d1487 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d882f5ba-140e-4a3c-9a41-43a759805bf8 req-8480fe51-c235-435d-88db-4500f15d1487 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG nova.compute.manager [req-d882f5ba-140e-4a3c-9a41-43a759805bf8 req-8480fe51-c235-435d-88db-4500f15d1487 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:23 user nova-compute[74934]: WARNING nova.compute.manager [req-d882f5ba-140e-4a3c-9a41-43a759805bf8 req-8480fe51-c235-435d-88db-4500f15d1487 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_migrating.
Nov 19 15:01:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance destroyed successfully.
Nov 19 15:01:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696276764',display_name='tempest-ServerActionsTestOtherA-server-696276764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-696276764',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-lnfmhdyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=b84f250c-ee76-451f-bf66-68e25842b7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e3cf8bc-d4, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79233f4f-e887-4256-9b79-8071be3d4158) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: INFO os_vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4')
Nov 19 15:01:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:24 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb126f8-f0cc-4017-a50a-07d1fe66d375]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:01:24 user nova-compute[74934]: No targets found.
Nov 19 15:01:24 user nova-compute[74934]: iSNS:
Nov 19 15:01:24 user nova-compute[74934]: No targets found.
Nov 19 15:01:24 user nova-compute[74934]: STATIC:
Nov 19 15:01:24 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:01:24 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:24 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:24 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 15:01:24 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:24 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:24 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:01:24 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:24 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:24 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b
Nov 19 15:01:24 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:24 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:24 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:01:24 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:24 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:24 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 15:01:24 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:01:24 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:01:24 user nova-compute[74934]: FIRMWARE:
Nov 19 15:01:24 user nova-compute[74934]: No targets found.
Nov 19 15:01:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:01:24 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:01:24 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45b0c4-c0ee-4d21-8dd4-0095fc024ebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede38521-60de-4413-956a-d9099816dfbd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:24 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e45255a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3'): ({'sde'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Removing single pathed devices sde {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbdf632-7fd3-49af-a6e3-8587f4acfcd1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb760164-f049-413f-a9e6-5c35785b103b]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flushing IO for device /dev/sde {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.037s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115eade-504c-429e-8b18-46b6c5b6524b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6ab5eb-81c0-4e88-9975-0655f3f30c98]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26239373439343239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8f25e5a4', '/dev/disk/by-id/scsi-1SCST_BIO8f25e5a4-b974942969e408c2') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86bab82-971b-42de-87d4-f2481c47f28a]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[636fd808-3366-4369-9534-52d45bc40746]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d244da9-f66b-42a5-ac30-dd3d6e99459e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]
Nov 19 15:01:24 user nova-compute[74934]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.
Nov 19 15:01:24 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[73223a31-39ff-4d18-8a21-d513a97c466d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== disconnect_volume: return (450ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:25 user nova-compute[74934]: INFO nova.compute.manager [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Rescuing
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Port 9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe binding to destination host user is already ACTIVE {{(pid=74934) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:25 user nova-compute[74934]: WARNING nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_migrating.
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:25 user nova-compute[74934]: WARNING nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_migrating.
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:25 user nova-compute[74934]: WARNING nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_migrating.
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:25 user nova-compute[74934]: WARNING nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_migrating.
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:25 user nova-compute[74934]: WARNING nova.compute.manager [req-936e3916-9d2d-4a70-98c8-27743fb5a361 req-b2518291-7149-4b78-9328-700fb476c1e2 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_migrating.
Nov 19 15:01:25 user nova-compute[74934]: DEBUG nova.network.neutron [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating instance_info_cache with network_info: [{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquired lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-323fc56d-fca3-4d8a-b2ef-fe406023e115 req-fba74f3a-1aed-44dd-a17f-d9b6a46cb7c1 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-323fc56d-fca3-4d8a-b2ef-fe406023e115 req-fba74f3a-1aed-44dd-a17f-d9b6a46cb7c1 service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-323fc56d-fca3-4d8a-b2ef-fe406023e115 req-fba74f3a-1aed-44dd-a17f-d9b6a46cb7c1 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-323fc56d-fca3-4d8a-b2ef-fe406023e115 req-fba74f3a-1aed-44dd-a17f-d9b6a46cb7c1 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-323fc56d-fca3-4d8a-b2ef-fe406023e115 req-fba74f3a-1aed-44dd-a17f-d9b6a46cb7c1 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:26 user nova-compute[74934]: WARNING nova.compute.manager [req-323fc56d-fca3-4d8a-b2ef-fe406023e115 req-fba74f3a-1aed-44dd-a17f-d9b6a46cb7c1 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state active and task_state rescuing.
Nov 19 15:01:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Releasing lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG os_brick.utils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca92265-9624-4ec4-9122-c5675ca8cabc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[04390c05-81cc-4a19-8b8d-1bd6b0f7a608]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance destroyed successfully.
Nov 19 15:01:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Attempting a stable device rescue
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e16f8-39af-4c3c-a714-9e210d5dc33b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[41275b67-3c94-4752-a656-8e71a68ac9d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74934) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:01:26 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[980de413-73ef-4529-8c62-a45f91972d2c]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG os_brick.utils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 15:01:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Creating image(s)
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "/opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "/opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'trusted_certs' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "814c517469b2dfe4bf697833ad1e75067b463954" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "814c517469b2dfe4bf697833ad1e75067b463954" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.part --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG nova.virt.images [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] a3e69ca6-b5c0-4698-b51f-00b17e266b83 was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.part /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-51f50991-68d2-4394-a69c-798d87ad6505 req-376e4cbc-f7bf-49e5-9d83-b1d3e4923101 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51f50991-68d2-4394-a69c-798d87ad6505 req-376e4cbc-f7bf-49e5-9d83-b1d3e4923101 service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51f50991-68d2-4394-a69c-798d87ad6505 req-376e4cbc-f7bf-49e5-9d83-b1d3e4923101 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51f50991-68d2-4394-a69c-798d87ad6505 req-376e4cbc-f7bf-49e5-9d83-b1d3e4923101 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-51f50991-68d2-4394-a69c-798d87ad6505 req-376e4cbc-f7bf-49e5-9d83-b1d3e4923101 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:28 user nova-compute[74934]: WARNING nova.compute.manager [req-51f50991-68d2-4394-a69c-798d87ad6505 req-376e4cbc-f7bf-49e5-9d83-b1d3e4923101 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state active and task_state rescuing.
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.part /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.converted" returned: 0 in 0.535s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954.converted --force-share --output=json" returned: 0 in 0.256s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "814c517469b2dfe4bf697833ad1e75067b463954" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.994s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "814c517469b2dfe4bf697833ad1e75067b463954" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "814c517469b2dfe4bf697833ad1e75067b463954" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954 --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954 --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954,backing_fmt=raw /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954,backing_fmt=raw /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue" returned: 0 in 0.049s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "814c517469b2dfe4bf697833ad1e75067b463954" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.instance [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'migration_context' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<069f95a6-6e49-4054-baf6-7da3d23c0514> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Start _get_guest_xml network_info=[{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "vif_mac": "fa:16:3e:56:07:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a3e69ca6-b5c0-4698-b51f-00b17e266b83', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '0ca310b5-2ef7-455c-bb38-20c7c5cc2dbf', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '069f95a6-6e49-4054-baf6-7da3d23c0514', 'attached_at': '', 'detached_at': '', 'volume_id': '123f3d77-d1a9-4963-a249-9e1f6037a833', 'serial': '123f3d77-d1a9-4963-a249-9e1f6037a833'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.instance [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'resources' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<069f95a6-6e49-4054-baf6-7da3d23c0514> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.instance [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'numa_topology' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<069f95a6-6e49-4054-baf6-7da3d23c0514> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:29 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:29 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.instance [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'vcpu_model' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<069f95a6-6e49-4054-baf6-7da3d23c0514> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:29 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:29 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:29 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a3e8c-41fd-4647-96ba-de3b37441b73]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TbcsGmAJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 19 15:01:29 user nova-compute[74934]: node.name = iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:01:29 user nova-compute[74934]: node.tpgt = -1
Nov 19 15:01:29 user nova-compute[74934]: node.startup = automatic
Nov 19 15:01:29 user nova-compute[74934]: node.leading_login = No
Nov 19 15:01:29 user nova-compute[74934]: iface.iscsi_ifacename = default
Nov 19 15:01:29 user nova-compute[74934]: iface.net_ifacename = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.ipaddress = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.prefix_len = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.hwaddress = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.transport_name = tcp
Nov 19 15:01:29 user nova-compute[74934]: iface.initiatorname = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.vlan_id = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.vlan_priority = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.vlan_state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.iface_num = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.mtu = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.port = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.bootproto = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.subnet_mask = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.gateway = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_alt_client_id_state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_alt_client_id = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_dns = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_learn_iqn = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_req_vendor_id_state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_vendor_id_state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_vendor_id = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.dhcp_slp_da = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.fragmentation = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.gratuitous_arp = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.incoming_forwarding = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.tos_state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.tos = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.ttl = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.delayed_ack = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.tcp_nagle = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.tcp_wsf_state = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.tcp_wsf = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.tcp_timer_scale = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.tcp_timestamp = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.redirect = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.def_task_mgmt_timeout = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.header_digest = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.data_digest = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.immediate_data = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.initial_r2t = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.data_seq_inorder = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.data_pdu_inorder = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.erl = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.max_receive_data_len = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.first_burst_len = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.max_outstanding_r2t = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.max_burst_len = 0
Nov 19 15:01:29 user nova-compute[74934]: iface.chap_auth = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.bidi_chap = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.strict_login_compliance = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.discovery_auth = <empty>
Nov 19 15:01:29 user nova-compute[74934]: iface.discovery_logout = <empty>
Nov 19 15:01:29 user nova-compute[74934]: node.discovery_address = <empty>
Nov 19 15:01:29 user nova-compute[74934]: node.discovery_port = 0
Nov 19 15:01:29 user nova-compute[74934]: node.discovery_type = static
Nov 19 15:01:29 user nova-compute[74934]: node.session.initial_cmdsn = 0
Nov 19 15:01:29 user nova-compute[74934]: node.session.initial_login_retry_max = 8
Nov 19 15:01:29 user nova-compute[74934]: node.session.xmit_thread_priority = -20
Nov 19 15:01:29 user nova-compute[74934]: node.session.cmds_max = 128
Nov 19 15:01:29 user nova-compute[74934]: node.session.queue_depth = 32
Nov 19 15:01:29 user nova-compute[74934]: node.session.nr_sessions = 1
Nov 19 15:01:29 user nova-compute[74934]: node.session.auth.authmethod = CHAP
Nov 19 15:01:29 user nova-compute[74934]: node.session.auth.username = TbcsGmAJ
Nov 19 15:01:29 user nova-compute[74934]: node.session.auth.password = ***
Nov 19 15:01:29 user nova-compute[74934]: node.session.auth.username_in = <empty>
Nov 19 15:01:29 user nova-compute[74934]: node.session.auth.password_in = <empty>
Nov 19 15:01:29 user nova-compute[74934]: node.session.auth.chap_algs = MD5
Nov 19 15:01:29 user nova-compute[74934]: node.session.timeo.replacement_timeout = 120
Nov 19 15:01:29 user nova-compute[74934]: node.session.err_timeo.abort_timeout = 15
Nov 19 15:01:29 user nova-compute[74934]: node.session.err_timeo.lu_reset_timeout = 30
Nov 19 15:01:29 user nova-compute[74934]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 19 15:01:29 user nova-compute[74934]: node.session.err_timeo.host_reset_timeout = 60
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.FastAbort = Yes
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.InitialR2T = No
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.ImmediateData = Yes
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.FirstBurstLength = 262144
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.MaxBurstLength = 16776192
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.DefaultTime2Retain = 0
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.DefaultTime2Wait = 2
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.MaxConnections = 1
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 19 15:01:29 user nova-compute[74934]: node.session.iscsi.ERL = 0
Nov 19 15:01:29 user nova-compute[74934]: node.session.scan = manual
Nov 19 15:01:29 user nova-compute[74934]: node.session.reopen_max = 0
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].address = 172.16.0.220
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].port = 3260
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].startup = manual
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].tcp.window_size = 524288
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].tcp.type_of_service = 0
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].timeo.logout_timeout = 15
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].timeo.login_timeout = 15
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].timeo.auth_timeout = 45
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].timeo.noop_out_interval = 5
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].timeo.noop_out_timeout = 5
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].iscsi.HeaderDigest = None
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].iscsi.DataDigest = None
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].iscsi.IFMarker = No
Nov 19 15:01:29 user nova-compute[74934]: node.conn[0].iscsi.OFMarker = No
Nov 19 15:01:29 user nova-compute[74934]: # END RECORD
Nov 19 15:01:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f4ad9-d162-456a-9f11-84230f8b82e2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc50412f-5fe8-42f7-b418-ae8e38f41887]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbcsGmAJ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbcsGmAJ" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c8666-03ec-488a-bcca-2cc6e4047dce]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TbcsGmAJ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0198c84-d303-40d2-a3ee-cc6d253f4e2f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[42464498-186d-41ca-9f0e-e2b99029932b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:29 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:29 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.162s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] HCTL ('37', '0', '0', 0) found on session 32 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9a198-21af-40ab-9fee-ccf5772d22ed]: (4, ('0 0 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Searching for a device in session 32 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '23437356231353138', 'path': '/dev/sdf'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437356231353138', 'path': '/dev/sdf'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1041188902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1041188902',id=34,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-5rhaa0c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T14:59:54Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=069f95a6-6e49-4054-baf6-7da3d23c0514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "vif_mac": "fa:16:3e:56:07:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "vif_mac": "fa:16:3e:56:07:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.instance [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'pci_devices' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.objects.base [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Object Instance<069f95a6-6e49-4054-baf6-7da3d23c0514> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:01:29 user nova-compute[74934]:   <uuid>069f95a6-6e49-4054-baf6-7da3d23c0514</uuid>
Nov 19 15:01:29 user nova-compute[74934]:   <name>instance-00000022</name>
Nov 19 15:01:29 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:01:29 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:01:29 user nova-compute[74934]:   <metadata>
Nov 19 15:01:29 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:01:29 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:01:29 user nova-compute[74934]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1041188902</nova:name>
Nov 19 15:01:29 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:01:29</nova:creationTime>
Nov 19 15:01:29 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:01:29 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:01:29 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:01:29 user nova-compute[74934]:       <nova:owner>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:user uuid="08d75edb533b4dfca6e9785c439df050">tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member</nova:user>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:project uuid="0da5862e932d40a68f17b4e8bb77ef77">tempest-ServerBootFromVolumeStableRescueTest-1047020547</nova:project>
Nov 19 15:01:29 user nova-compute[74934]:       </nova:owner>
Nov 19 15:01:29 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:01:29 user nova-compute[74934]:       <nova:ports>
Nov 19 15:01:29 user nova-compute[74934]:         <nova:port uuid="92a12e86-cd82-472f-88ea-0d6c6e9556fc">
Nov 19 15:01:29 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 19 15:01:29 user nova-compute[74934]:         </nova:port>
Nov 19 15:01:29 user nova-compute[74934]:       </nova:ports>
Nov 19 15:01:29 user nova-compute[74934]:     </nova:instance>
Nov 19 15:01:29 user nova-compute[74934]:   </metadata>
Nov 19 15:01:29 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:01:29 user nova-compute[74934]:     <system>
Nov 19 15:01:29 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:01:29 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:01:29 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:01:29 user nova-compute[74934]:       <entry name="serial">069f95a6-6e49-4054-baf6-7da3d23c0514</entry>
Nov 19 15:01:29 user nova-compute[74934]:       <entry name="uuid">069f95a6-6e49-4054-baf6-7da3d23c0514</entry>
Nov 19 15:01:29 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:01:29 user nova-compute[74934]:     </system>
Nov 19 15:01:29 user nova-compute[74934]:   </sysinfo>
Nov 19 15:01:29 user nova-compute[74934]:   <os>
Nov 19 15:01:29 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:01:29 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:01:29 user nova-compute[74934]:   </os>
Nov 19 15:01:29 user nova-compute[74934]:   <features>
Nov 19 15:01:29 user nova-compute[74934]:     <acpi/>
Nov 19 15:01:29 user nova-compute[74934]:     <apic/>
Nov 19 15:01:29 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:01:29 user nova-compute[74934]:   </features>
Nov 19 15:01:29 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:01:29 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:01:29 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:01:29 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:01:29 user nova-compute[74934]:   </clock>
Nov 19 15:01:29 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:01:29 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:01:29 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:01:29 user nova-compute[74934]:   </cpu>
Nov 19 15:01:29 user nova-compute[74934]:   <devices>
Nov 19 15:01:29 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:01:29 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:01:29 user nova-compute[74934]:       <source dev="/dev/sdf"/>
Nov 19 15:01:29 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:01:29 user nova-compute[74934]:       <serial>123f3d77-d1a9-4963-a249-9e1f6037a833</serial>
Nov 19 15:01:29 user nova-compute[74934]:     </disk>
Nov 19 15:01:29 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:01:29 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:01:29 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue"/>
Nov 19 15:01:29 user nova-compute[74934]:       <target dev="vdb" bus="virtio"/>
Nov 19 15:01:29 user nova-compute[74934]:       <boot order="1"/>
Nov 19 15:01:29 user nova-compute[74934]:     </disk>
Nov 19 15:01:29 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:01:29 user nova-compute[74934]:       <mac address="fa:16:3e:56:07:fd"/>
Nov 19 15:01:29 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:29 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:01:29 user nova-compute[74934]:       <target dev="tap92a12e86-cd"/>
Nov 19 15:01:29 user nova-compute[74934]:     </interface>
Nov 19 15:01:29 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:01:29 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/console.log" append="off"/>
Nov 19 15:01:29 user nova-compute[74934]:     </serial>
Nov 19 15:01:29 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:01:29 user nova-compute[74934]:     <video>
Nov 19 15:01:29 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:29 user nova-compute[74934]:     </video>
Nov 19 15:01:29 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:01:29 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:01:29 user nova-compute[74934]:     </rng>
Nov 19 15:01:29 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:01:29 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:01:29 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:01:29 user nova-compute[74934]:     </memballoon>
Nov 19 15:01:29 user nova-compute[74934]:   </devices>
Nov 19 15:01:29 user nova-compute[74934]: </domain>
Nov 19 15:01:29 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:01:29 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance destroyed successfully.
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:01:29 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] No VIF found with MAC fa:16:3e:56:07:fd, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:01:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-0d27c118-a75b-49ce-8240-c2aecb68dbef req-563b2214-7953-4791-b892-358fc9d5941a service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0d27c118-a75b-49ce-8240-c2aecb68dbef req-563b2214-7953-4791-b892-358fc9d5941a service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0d27c118-a75b-49ce-8240-c2aecb68dbef req-563b2214-7953-4791-b892-358fc9d5941a service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0d27c118-a75b-49ce-8240-c2aecb68dbef req-563b2214-7953-4791-b892-358fc9d5941a service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-0d27c118-a75b-49ce-8240-c2aecb68dbef req-563b2214-7953-4791-b892-358fc9d5941a service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:31 user nova-compute[74934]: WARNING nova.compute.manager [req-0d27c118-a75b-49ce-8240-c2aecb68dbef req-563b2214-7953-4791-b892-358fc9d5941a service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state active and task_state rescuing.
Nov 19 15:01:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Starting finish_migration {{(pid=74934) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance directory exists: not creating {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 19 15:01:32 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Creating image(s)
Nov 19 15:01:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Ensure instance console log exists: /opt/stack/data/nova/instances/b84f250c-ee76-451f-bf66-68e25842b7e8/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Start _get_guest_xml network_info=[{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '7223fa03-752c-43dd-a2af-1643acf4003f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b84f250c-ee76-451f-bf66-68e25842b7e8', 'attached_at': '2023-11-19T15:01:33.000000', 'detached_at': '', 'volume_id': '57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'serial': '57bf72fa-eafa-46f5-b4f3-37a469530bf3'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:01:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:01:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:33 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:33 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:33 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c40b801-e0bf-4fa6-8d42-863b3748356b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:01:33 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e017b09-84b7-4545-9ec4-3472366ddf54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3] added
Nov 19 15:01:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a70ba-26a0-4991-92f6-4283fb33f793]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca06ac7-daea-49f0-87c8-045563559b74]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWzhEYqR {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWzhEYqR" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a73f602-1b0c-4f85-9068-c68d94d6d912]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mWzhEYqR'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e29771-4d24-4978-b6f0-64ebf0727600]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-3cc6fd0e-f164-4763-a507-330360b6d1ba req-8741cab2-8945-49d0-a040-869d309a8d71 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3cc6fd0e-f164-4763-a507-330360b6d1ba req-8741cab2-8945-49d0-a040-869d309a8d71 service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3cc6fd0e-f164-4763-a507-330360b6d1ba req-8741cab2-8945-49d0-a040-869d309a8d71 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3cc6fd0e-f164-4763-a507-330360b6d1ba req-8741cab2-8945-49d0-a040-869d309a8d71 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-3cc6fd0e-f164-4763-a507-330360b6d1ba req-8741cab2-8945-49d0-a040-869d309a8d71 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:33 user nova-compute[74934]: WARNING nova.compute.manager [req-3cc6fd0e-f164-4763-a507-330360b6d1ba req-8741cab2-8945-49d0-a040-869d309a8d71 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state active and task_state rescuing.
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d2ca6-afca-4d3a-88a4-e7ca9da4165e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-38b48489-ecc3-4f27-af44-7763dab6ae9d tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e23f8d-2a1d-4255-a59f-877b1de03399]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]
Nov 19 15:01:33 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.
Nov 19 15:01:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b07b5-6cd1-4d9f-a4e2-e92fc331f4b7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0f08c-3421-44fb-8062-bd2023eda501]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:33 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:33 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a661ef-9667-4acd-8aec-47dfba178598]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:01:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26239373439343239', 'path': '/dev/sde'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373439343239', 'path': '/dev/sde'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696276764',display_name='tempest-ServerActionsTestOtherA-server-696276764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-696276764',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-lnfmhdyt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=b84f250c-ee76-451f-bf66-68e25842b7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:01:34 user nova-compute[74934]:   <uuid>b84f250c-ee76-451f-bf66-68e25842b7e8</uuid>
Nov 19 15:01:34 user nova-compute[74934]:   <name>instance-00000021</name>
Nov 19 15:01:34 user nova-compute[74934]:   <memory>2097152</memory>
Nov 19 15:01:34 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:01:34 user nova-compute[74934]:   <metadata>
Nov 19 15:01:34 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:01:34 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:01:34 user nova-compute[74934]:       <nova:name>tempest-ServerActionsTestOtherA-server-696276764</nova:name>
Nov 19 15:01:34 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:01:32</nova:creationTime>
Nov 19 15:01:34 user nova-compute[74934]:       <nova:flavor name="m1.small">
Nov 19 15:01:34 user nova-compute[74934]:         <nova:memory>2048</nova:memory>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:disk>20</nova:disk>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:01:34 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:01:34 user nova-compute[74934]:       <nova:owner>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:user uuid="77319d6b70b24f22b39342f6955a8fef">tempest-ServerActionsTestOtherA-463456576-project-member</nova:user>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:project uuid="bd2d42525428465c90522337ec5a4b82">tempest-ServerActionsTestOtherA-463456576</nova:project>
Nov 19 15:01:34 user nova-compute[74934]:       </nova:owner>
Nov 19 15:01:34 user nova-compute[74934]:       <nova:ports>
Nov 19 15:01:34 user nova-compute[74934]:         <nova:port uuid="9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe">
Nov 19 15:01:34 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 15:01:34 user nova-compute[74934]:         </nova:port>
Nov 19 15:01:34 user nova-compute[74934]:       </nova:ports>
Nov 19 15:01:34 user nova-compute[74934]:     </nova:instance>
Nov 19 15:01:34 user nova-compute[74934]:   </metadata>
Nov 19 15:01:34 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:01:34 user nova-compute[74934]:     <system>
Nov 19 15:01:34 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:01:34 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:01:34 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:01:34 user nova-compute[74934]:       <entry name="serial">b84f250c-ee76-451f-bf66-68e25842b7e8</entry>
Nov 19 15:01:34 user nova-compute[74934]:       <entry name="uuid">b84f250c-ee76-451f-bf66-68e25842b7e8</entry>
Nov 19 15:01:34 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:01:34 user nova-compute[74934]:     </system>
Nov 19 15:01:34 user nova-compute[74934]:   </sysinfo>
Nov 19 15:01:34 user nova-compute[74934]:   <os>
Nov 19 15:01:34 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:01:34 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:01:34 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:01:34 user nova-compute[74934]:   </os>
Nov 19 15:01:34 user nova-compute[74934]:   <features>
Nov 19 15:01:34 user nova-compute[74934]:     <acpi/>
Nov 19 15:01:34 user nova-compute[74934]:     <apic/>
Nov 19 15:01:34 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:01:34 user nova-compute[74934]:   </features>
Nov 19 15:01:34 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:01:34 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:01:34 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:01:34 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:01:34 user nova-compute[74934]:   </clock>
Nov 19 15:01:34 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:01:34 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:01:34 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:01:34 user nova-compute[74934]:   </cpu>
Nov 19 15:01:34 user nova-compute[74934]:   <devices>
Nov 19 15:01:34 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:01:34 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:01:34 user nova-compute[74934]:       <source dev="/dev/sde"/>
Nov 19 15:01:34 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:01:34 user nova-compute[74934]:       <serial>57bf72fa-eafa-46f5-b4f3-37a469530bf3</serial>
Nov 19 15:01:34 user nova-compute[74934]:     </disk>
Nov 19 15:01:34 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:01:34 user nova-compute[74934]:       <mac address="fa:16:3e:46:c6:b9"/>
Nov 19 15:01:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:34 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:01:34 user nova-compute[74934]:       <target dev="tap9e3cf8bc-d4"/>
Nov 19 15:01:34 user nova-compute[74934]:     </interface>
Nov 19 15:01:34 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:01:34 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/b84f250c-ee76-451f-bf66-68e25842b7e8/console.log" append="off"/>
Nov 19 15:01:34 user nova-compute[74934]:     </serial>
Nov 19 15:01:34 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:01:34 user nova-compute[74934]:     <video>
Nov 19 15:01:34 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:01:34 user nova-compute[74934]:     </video>
Nov 19 15:01:34 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:01:34 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:01:34 user nova-compute[74934]:     </rng>
Nov 19 15:01:34 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:01:34 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:01:34 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:01:34 user nova-compute[74934]:     </memballoon>
Nov 19 15:01:34 user nova-compute[74934]:   </devices>
Nov 19 15:01:34 user nova-compute[74934]: </domain>
Nov 19 15:01:34 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696276764',display_name='tempest-ServerActionsTestOtherA-server-696276764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-696276764',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-lnfmhdyt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=b84f250c-ee76-451f-bf66-68e25842b7e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-760124211-network", "vif_mac": "fa:16:3e:46:c6:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG os_vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b031c54-6f95-5a64-b17e-84541f777266', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e3cf8bc-d4, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e3cf8bc-d4, col_values=(('qos', UUID('f823fd68-041d-420b-8cfa-dab229646332')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e3cf8bc-d4, col_values=(('external_ids', {'iface-id': '9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:c6:b9', 'vm-uuid': 'b84f250c-ee76-451f-bf66-68e25842b7e8'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:34 user nova-compute[74934]: INFO os_vif [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4')
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:01:34 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] No VIF found with MAC fa:16:3e:46:c6:b9, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:01:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-a48b7077-9c33-477c-bcc4-6e313994804e req-50116d02-9c8f-4b18-99af-de17c2e39139 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a48b7077-9c33-477c-bcc4-6e313994804e req-50116d02-9c8f-4b18-99af-de17c2e39139 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a48b7077-9c33-477c-bcc4-6e313994804e req-50116d02-9c8f-4b18-99af-de17c2e39139 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a48b7077-9c33-477c-bcc4-6e313994804e req-50116d02-9c8f-4b18-99af-de17c2e39139 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG nova.compute.manager [req-a48b7077-9c33-477c-bcc4-6e313994804e req-50116d02-9c8f-4b18-99af-de17c2e39139 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:36 user nova-compute[74934]: WARNING nova.compute.manager [req-a48b7077-9c33-477c-bcc4-6e313994804e req-50116d02-9c8f-4b18-99af-de17c2e39139 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_finish.
Nov 19 15:01:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-3e6932f2-923c-481c-b101-26b43f83f9b6 req-67c040d1-4a07-4123-8555-f29ec3bbb941 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3e6932f2-923c-481c-b101-26b43f83f9b6 req-67c040d1-4a07-4123-8555-f29ec3bbb941 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3e6932f2-923c-481c-b101-26b43f83f9b6 req-67c040d1-4a07-4123-8555-f29ec3bbb941 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3e6932f2-923c-481c-b101-26b43f83f9b6 req-67c040d1-4a07-4123-8555-f29ec3bbb941 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-3e6932f2-923c-481c-b101-26b43f83f9b6 req-67c040d1-4a07-4123-8555-f29ec3bbb941 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:01:38 user nova-compute[74934]: WARNING nova.compute.manager [req-3e6932f2-923c-481c-b101-26b43f83f9b6 req-67c040d1-4a07-4123-8555-f29ec3bbb941 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state resize_finish.
Nov 19 15:01:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:01:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance running successfully.
Nov 19 15:01:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Failed to set time: agent not configured {{(pid=74934) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 19 15:01:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d6ab4eb9-5c7d-4959-819b-c45b3a432246 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] finish_migration finished successfully. {{(pid=74934) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 19 15:01:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-changed-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Refreshing instance network info cache due to event network-changed-e577961b-b83a-4b35-9599-a725cbb19690. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] Acquiring lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] Acquired lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG nova.network.neutron [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Refreshing network info cache for port e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG nova.network.neutron [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updated VIF entry in instance network info cache for port e577961b-b83a-4b35-9599-a725cbb19690. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG nova.network.neutron [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updating instance_info_cache with network_info: [{"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:01:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee9cbf74-f89f-41d0-8eba-261ab4256254 req-953d84a4-2f94-4441-bc3d-78f5c709e63e service nova] Releasing lock "refresh_cache-98c746cb-1a7a-4a76-b497-e803dfa7be71" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:01:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid 98c746cb-1a7a-4a76-b497-e803dfa7be71 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:49 user nova-compute[74934]: INFO nova.compute.manager [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Attaching volume f717de38-3732-4d88-9688-a53faab53524 to /dev/vdb
Nov 19 15:01:49 user nova-compute[74934]: DEBUG os_brick.utils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[51989a1c-3f6e-41e6-8a26-6fedee8ed045]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b200e-c3ed-440b-9bb8-3597573df7c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8b6b9b-49f9-43f9-a822-e7fc569b4d2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa043a0d-2abc-49cd-9f30-e678c0a4fe12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:01:49 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:01:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a911789f-2553-478a-a8c6-a97d62f0fcae]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG os_brick.utils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updating existing volume attachment record: cc33eeaf-ec8f-4668-8aa3-3b3731466742 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:01:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:54 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYSWgrbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:01:55 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:55 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:01:55 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7d3c49-73d3-45f2-83f7-c44e0f473f1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:01:55 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddc4a4f-d7b1-4b70-873d-6f97a13a2fed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524] added
Nov 19 15:01:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a5d3d-0ce7-4e84-841d-0c6f00d35d1d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c82781-11c8-494e-8539-92e3f9b51184]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYSWgrbe {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYSWgrbe" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdc92c5-5857-422a-9711-dd5194df67ec]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYSWgrbe'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27133b3-3192-4fdd-ac08-05cb71725f2d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[546cfcd3-2ac8-4d47-bbdf-1d49aa08b335]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:55 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --login" returned: 0 in 1.081s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[323b4591-3578-4ce0-90dc-98c1131c0a73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260]
Nov 19 15:01:56 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260] successful.
Nov 19 15:01:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[950f8fca-f114-4c41-806a-31a8ff785833]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c7771c-91d0-48f4-95eb-1034527f6646]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 (non-flash)
Nov 19 15:01:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:01:56 user nova-compute[74934]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 (non-flash)
Nov 19 15:01:56 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.343s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a26c10-2ff0-4102-8c2c-4cf1ebda3272]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:01:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYSWgrbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:01:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.381s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:01:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== connect_volume: return (2383ms) {'type': 'block', 'scsi_wwn': '26231613632323734', 'path': '/dev/sdh'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:01:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231613632323734', 'path': '/dev/sdh'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:01:57 user nova-compute[74934]: DEBUG nova.objects.instance [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid 98c746cb-1a7a-4a76-b497-e803dfa7be71 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:01:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:01:57 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:01:57 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 15:01:57 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:01:57 user nova-compute[74934]:   <serial>f717de38-3732-4d88-9688-a53faab53524</serial>
Nov 19 15:01:57 user nova-compute[74934]: </disk>
Nov 19 15:01:57 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:ed:c9:4f, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25d47955-915f-4a4e-99d2-93cb80573126 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.111s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:58 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:01:58 user nova-compute[74934]: INFO nova.compute.claims [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Claim successful on node user
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:59 user nova-compute[74934]: INFO nova.compute.manager [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Detaching volume f717de38-3732-4d88-9688-a53faab53524
Nov 19 15:01:59 user nova-compute[74934]: INFO nova.virt.block_device [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Attempting to driver detach volume f717de38-3732-4d88-9688-a53faab53524 from mountpoint /dev/vdb
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Attempting to detach device vdb from instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:01:59 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:01:59 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 15:01:59 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:01:59 user nova-compute[74934]:   <serial>f717de38-3732-4d88-9688-a53faab53524</serial>
Nov 19 15:01:59 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:01:59 user nova-compute[74934]: </disk>
Nov 19 15:01:59 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:01:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully detached device vdb from instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 from the persistent domain config.
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:01:59 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:01:59 user nova-compute[74934]:   <source dev="/dev/sdh"/>
Nov 19 15:01:59 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:01:59 user nova-compute[74934]:   <serial>f717de38-3732-4d88-9688-a53faab53524</serial>
Nov 19 15:01:59 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:01:59 user nova-compute[74934]: </disk>
Nov 19 15:01:59 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:01:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.policy [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '626bafbaac4f4454a21f429798b56194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f136401348054bdaa49dc9a1f71a27b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:01:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Creating image(s)
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "/opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "/opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:01:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "/opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.201s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.229s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk 1073741824" returned: 0 in 0.058s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Successfully created port: 09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.216s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Cannot resize image /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Ensure instance console log exists: /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Successfully updated port: 09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquired lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-changed-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Refreshing instance network info cache due to event network-changed-09874d1f-26ee-47a8-962d-3aeba7286674. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] Acquiring lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating instance_info_cache with network_info: [{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Releasing lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Instance network_info: |[{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] Acquired lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Refreshing network info cache for port 09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Start _get_guest_xml network_info=[{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:02:01 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:02:01 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316930228',display_name='tempest-TestStampPattern-server-1316930228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1316930228',id=36,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaznw+RT83MzYqjptBb1X4uW71wuVbCdmq+x1BcxoN6wge7Gyi94Xn4EaUTF1JIME5dMfgYbCZc4W6KVhbk5bf817if+fSPUvesBQahayNGBEygMuHSuo8LZiRqixE7vA==',key_name='tempest-TestStampPattern-449749249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f136401348054bdaa49dc9a1f71a27b8',ramdisk_id='',reservation_id='r-vkvd13tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-310548474',owner_user_name='tempest-TestStampPattern-310548474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:02:00Z,user_data=None,user_id='626bafbaac4f4454a21f429798b56194',uuid=edd37f42-f320-4a31-a4a0-2d0441123a61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converting VIF {"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'pci_devices' on Instance uuid edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:02:01 user nova-compute[74934]:   <uuid>edd37f42-f320-4a31-a4a0-2d0441123a61</uuid>
Nov 19 15:02:01 user nova-compute[74934]:   <name>instance-00000024</name>
Nov 19 15:02:01 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:02:01 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:02:01 user nova-compute[74934]:   <metadata>
Nov 19 15:02:01 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:02:01 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:02:01 user nova-compute[74934]:       <nova:name>tempest-TestStampPattern-server-1316930228</nova:name>
Nov 19 15:02:01 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:02:01</nova:creationTime>
Nov 19 15:02:01 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:02:01 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:02:01 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:02:01 user nova-compute[74934]:       <nova:owner>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:user uuid="626bafbaac4f4454a21f429798b56194">tempest-TestStampPattern-310548474-project-member</nova:user>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:project uuid="f136401348054bdaa49dc9a1f71a27b8">tempest-TestStampPattern-310548474</nova:project>
Nov 19 15:02:01 user nova-compute[74934]:       </nova:owner>
Nov 19 15:02:01 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:02:01 user nova-compute[74934]:       <nova:ports>
Nov 19 15:02:01 user nova-compute[74934]:         <nova:port uuid="09874d1f-26ee-47a8-962d-3aeba7286674">
Nov 19 15:02:01 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 19 15:02:01 user nova-compute[74934]:         </nova:port>
Nov 19 15:02:01 user nova-compute[74934]:       </nova:ports>
Nov 19 15:02:01 user nova-compute[74934]:     </nova:instance>
Nov 19 15:02:01 user nova-compute[74934]:   </metadata>
Nov 19 15:02:01 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:02:01 user nova-compute[74934]:     <system>
Nov 19 15:02:01 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:02:01 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:02:01 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:02:01 user nova-compute[74934]:       <entry name="serial">edd37f42-f320-4a31-a4a0-2d0441123a61</entry>
Nov 19 15:02:01 user nova-compute[74934]:       <entry name="uuid">edd37f42-f320-4a31-a4a0-2d0441123a61</entry>
Nov 19 15:02:01 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:02:01 user nova-compute[74934]:     </system>
Nov 19 15:02:01 user nova-compute[74934]:   </sysinfo>
Nov 19 15:02:01 user nova-compute[74934]:   <os>
Nov 19 15:02:01 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:02:01 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:02:01 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:02:01 user nova-compute[74934]:   </os>
Nov 19 15:02:01 user nova-compute[74934]:   <features>
Nov 19 15:02:01 user nova-compute[74934]:     <acpi/>
Nov 19 15:02:01 user nova-compute[74934]:     <apic/>
Nov 19 15:02:01 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:02:01 user nova-compute[74934]:   </features>
Nov 19 15:02:01 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:02:01 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:02:01 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:02:01 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:02:01 user nova-compute[74934]:   </clock>
Nov 19 15:02:01 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:02:01 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:02:01 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:02:01 user nova-compute[74934]:   </cpu>
Nov 19 15:02:01 user nova-compute[74934]:   <devices>
Nov 19 15:02:01 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:02:01 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:02:01 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk"/>
Nov 19 15:02:01 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:02:01 user nova-compute[74934]:     </disk>
Nov 19 15:02:01 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:02:01 user nova-compute[74934]:       <mac address="fa:16:3e:48:c4:03"/>
Nov 19 15:02:01 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:02:01 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:02:01 user nova-compute[74934]:       <target dev="tap09874d1f-26"/>
Nov 19 15:02:01 user nova-compute[74934]:     </interface>
Nov 19 15:02:01 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:02:01 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/console.log" append="off"/>
Nov 19 15:02:01 user nova-compute[74934]:     </serial>
Nov 19 15:02:01 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:02:01 user nova-compute[74934]:     <video>
Nov 19 15:02:01 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:02:01 user nova-compute[74934]:     </video>
Nov 19 15:02:01 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:02:01 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:02:01 user nova-compute[74934]:     </rng>
Nov 19 15:02:01 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:02:01 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:02:01 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:02:01 user nova-compute[74934]:     </memballoon>
Nov 19 15:02:01 user nova-compute[74934]:   </devices>
Nov 19 15:02:01 user nova-compute[74934]: </domain>
Nov 19 15:02:01 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316930228',display_name='tempest-TestStampPattern-server-1316930228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1316930228',id=36,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaznw+RT83MzYqjptBb1X4uW71wuVbCdmq+x1BcxoN6wge7Gyi94Xn4EaUTF1JIME5dMfgYbCZc4W6KVhbk5bf817if+fSPUvesBQahayNGBEygMuHSuo8LZiRqixE7vA==',key_name='tempest-TestStampPattern-449749249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f136401348054bdaa49dc9a1f71a27b8',ramdisk_id='',reservation_id='r-vkvd13tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-310548474',owner_user_name='tempest-TestStampPattern-310548474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:02:00Z,user_data=None,user_id='626bafbaac4f4454a21f429798b56194',uuid=edd37f42-f320-4a31-a4a0-2d0441123a61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converting VIF {"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG os_vif [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b5b37a2-028e-5d43-95b6-b8e18e476c9c', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09874d1f-26, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09874d1f-26, col_values=(('qos', UUID('8e066fbd-175f-451b-b7b0-98d0132b2155')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09874d1f-26, col_values=(('external_ids', {'iface-id': '09874d1f-26ee-47a8-962d-3aeba7286674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:c4:03', 'vm-uuid': 'edd37f42-f320-4a31-a4a0-2d0441123a61'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:01 user nova-compute[74934]: INFO os_vif [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26')
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No VIF found with MAC fa:16:3e:48:c4:03, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updated VIF entry in instance network info cache for port 09874d1f-26ee-47a8-962d-3aeba7286674. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating instance_info_cache with network_info: [{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-352d6408-81bd-4f83-8267-8349d314a955 req-5810b670-e8e7-4b0a-a0b9-5e09241f58fd service nova] Releasing lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-f059621d-5423-4216-8bd8-ce6d738ffd0e req-dd521067-e685-4453-9855-13fd307ee910 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f059621d-5423-4216-8bd8-ce6d738ffd0e req-dd521067-e685-4453-9855-13fd307ee910 service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f059621d-5423-4216-8bd8-ce6d738ffd0e req-dd521067-e685-4453-9855-13fd307ee910 service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f059621d-5423-4216-8bd8-ce6d738ffd0e req-dd521067-e685-4453-9855-13fd307ee910 service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-f059621d-5423-4216-8bd8-ce6d738ffd0e req-dd521067-e685-4453-9855-13fd307ee910 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:03 user nova-compute[74934]: WARNING nova.compute.manager [req-f059621d-5423-4216-8bd8-ce6d738ffd0e req-dd521067-e685-4453-9855-13fd307ee910 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received unexpected event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with vm_state building and task_state spawning.
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing instance network info cache due to event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.network.neutron [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:02:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:02:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=6908MB free_disk=24.804248809814453GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Applying migration context for instance b84f250c-ee76-451f-bf66-68e25842b7e8 as it has an incoming, in-progress migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a. Migration status is finished {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 19 15:02:04 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating resource usage from migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 32eaf46a-1013-456e-9c2c-9f8805a53e20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 1d37c184-b5ab-4074-be81-26eab07f26ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 3c1e28e7-4514-4443-b365-da62a85bbc0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:02:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.network.neutron [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updated VIF entry in instance network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.network.neutron [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0e1b0bdf-4f33-4a62-a599-717849207dbc req-19670a5c-7726-4b1b-8d61-0cba3e7e5f22 service nova] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing instance network info cache due to event network-changed-4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] Acquiring lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] Acquired lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.network.neutron [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Refreshing network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.775s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Instance spawned successfully.
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-70cb6362-6cb7-4097-b7ca-4f255b663e3c req-afd9da7a-9b97-4e2d-a66d-e66aa8dfb137 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-70cb6362-6cb7-4097-b7ca-4f255b663e3c req-afd9da7a-9b97-4e2d-a66d-e66aa8dfb137 service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-70cb6362-6cb7-4097-b7ca-4f255b663e3c req-afd9da7a-9b97-4e2d-a66d-e66aa8dfb137 service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-70cb6362-6cb7-4097-b7ca-4f255b663e3c req-afd9da7a-9b97-4e2d-a66d-e66aa8dfb137 service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-70cb6362-6cb7-4097-b7ca-4f255b663e3c req-afd9da7a-9b97-4e2d-a66d-e66aa8dfb137 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:05 user nova-compute[74934]: WARNING nova.compute.manager [req-70cb6362-6cb7-4097-b7ca-4f255b663e3c req-afd9da7a-9b97-4e2d-a66d-e66aa8dfb137 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received unexpected event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with vm_state building and task_state spawning.
Nov 19 15:02:05 user nova-compute[74934]: INFO nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:05 user nova-compute[74934]: INFO nova.compute.manager [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Detaching volume 278aeff5-5107-476f-8471-9c0bcf58954b
Nov 19 15:02:05 user nova-compute[74934]: INFO nova.compute.manager [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Took 6.73 seconds to build instance.
Nov 19 15:02:05 user nova-compute[74934]: INFO nova.virt.block_device [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Attempting to driver detach volume 278aeff5-5107-476f-8471-9c0bcf58954b from mountpoint /dev/vdb
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4188051b-301d-4fa8-ad80-328975056477 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.858s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Attempting to detach device vdb from instance 3c1e28e7-4514-4443-b365-da62a85bbc0f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:02:05 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:02:05 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 15:02:05 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:02:05 user nova-compute[74934]:   <serial>278aeff5-5107-476f-8471-9c0bcf58954b</serial>
Nov 19 15:02:05 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:02:05 user nova-compute[74934]: </disk>
Nov 19 15:02:05 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:02:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully detached device vdb from instance 3c1e28e7-4514-4443-b365-da62a85bbc0f from the persistent domain config.
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c1e28e7-4514-4443-b365-da62a85bbc0f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:02:05 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:02:05 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 15:02:05 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:02:05 user nova-compute[74934]:   <serial>278aeff5-5107-476f-8471-9c0bcf58954b</serial>
Nov 19 15:02:05 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:02:05 user nova-compute[74934]: </disk>
Nov 19 15:02:05 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.network.neutron [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updated VIF entry in instance network info cache for port 4770ca31-6eb7-4de3-9cf1-c303e9399dd3. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG nova.network.neutron [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [{"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-512ae165-744f-4591-9964-66d22f7c41a8 req-e37d3e8c-44a4-45d7-8f6f-b88af6230435 service nova] Releasing lock "refresh_cache-3c1e28e7-4514-4443-b365-da62a85bbc0f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c1e28e7-4514-4443-b365-da62a85bbc0f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Updating instance_info_cache with network_info: [{"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-1d37c184-b5ab-4074-be81-26eab07f26ad" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:02:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:09 user nova-compute[74934]: INFO nova.compute.manager [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Terminating instance
Nov 19 15:02:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-30b59553-0d44-47c7-8283-b3e07f0f3449 req-088bedf6-963c-4c11-b0d3-0f0b9b97195f service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-vif-unplugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-30b59553-0d44-47c7-8283-b3e07f0f3449 req-088bedf6-963c-4c11-b0d3-0f0b9b97195f service nova] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-30b59553-0d44-47c7-8283-b3e07f0f3449 req-088bedf6-963c-4c11-b0d3-0f0b9b97195f service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-30b59553-0d44-47c7-8283-b3e07f0f3449 req-088bedf6-963c-4c11-b0d3-0f0b9b97195f service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-30b59553-0d44-47c7-8283-b3e07f0f3449 req-088bedf6-963c-4c11-b0d3-0f0b9b97195f service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] No waiting events found dispatching network-vif-unplugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-30b59553-0d44-47c7-8283-b3e07f0f3449 req-088bedf6-963c-4c11-b0d3-0f0b9b97195f service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-vif-unplugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:02:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Instance destroyed successfully.
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lazy-loading 'resources' on Instance uuid 1d37c184-b5ab-4074-be81-26eab07f26ad {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:53:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1979906954',display_name='tempest-ServersNegativeTestJSON-server-1979906954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1979906954',id=22,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6785ce4d07724430bc04f3b8fa17a17f',ramdisk_id='',reservation_id='r-v7a0ge9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1797626430',owner_user_name='tempest-ServersNegativeTestJSON-1797626430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:53:26Z,user_data=None,user_id='0dcd4276cf8a406c9c4fe6416d1a6542',uuid=1d37c184-b5ab-4074-be81-26eab07f26ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converting VIF {"id": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "address": "fa:16:3e:dd:81:c1", "network": {"id": "2f831bdb-780a-47ea-bea0-a33c6fbc5632", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-213213225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6785ce4d07724430bc04f3b8fa17a17f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap235b6a15-eb", "ovs_interfaceid": "235b6a15-ebbe-4985-b79d-68bfc4d5c402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG os_vif [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap235b6a15-eb, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=967ac09c-0583-4752-910a-d61e149d4555) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:10 user nova-compute[74934]: INFO os_vif [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:81:c1,bridge_name='br-int',has_traffic_filtering=True,id=235b6a15-ebbe-4985-b79d-68bfc4d5c402,network=Network(2f831bdb-780a-47ea-bea0-a33c6fbc5632),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap235b6a15-eb')
Nov 19 15:02:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Deleting instance files /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad_del
Nov 19 15:02:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Deletion of /opt/stack/data/nova/instances/1d37c184-b5ab-4074-be81-26eab07f26ad_del complete
Nov 19 15:02:10 user nova-compute[74934]: INFO nova.compute.manager [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 19 15:02:10 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:02:10 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:02:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:11 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Took 0.82 seconds to deallocate network for instance.
Nov 19 15:02:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] Acquiring lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] No waiting events found dispatching network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:12 user nova-compute[74934]: WARNING nova.compute.manager [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received unexpected event network-vif-plugged-235b6a15-ebbe-4985-b79d-68bfc4d5c402 for instance with vm_state deleted and task_state None.
Nov 19 15:02:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-441ea65f-0a27-4a5e-a74a-5f09bc498de2 req-7304372f-e6ac-4bf9-b4d5-b2f905c3a075 service nova] [instance: 1d37c184-b5ab-4074-be81-26eab07f26ad] Received event network-vif-deleted-235b6a15-ebbe-4985-b79d-68bfc4d5c402 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:12 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Deleted allocations for instance 1d37c184-b5ab-4074-be81-26eab07f26ad
Nov 19 15:02:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21099c59-e6de-4d13-9a19-72feb53aa7d8 tempest-ServersNegativeTestJSON-1797626430 tempest-ServersNegativeTestJSON-1797626430-project-member] Lock "1d37c184-b5ab-4074-be81-26eab07f26ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.491s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing instance network info cache due to event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:18 user nova-compute[74934]: INFO nova.compute.manager [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Detaching volume e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 15:02:18 user nova-compute[74934]: INFO nova.virt.block_device [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Attempting to driver detach volume e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a from mountpoint /dev/vdb
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Attempting to detach device vdb from instance 78b81733-fd30-4009-9945-0c34c3b88fbe from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:02:18 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:02:18 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:02:18 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:02:18 user nova-compute[74934]:   <serial>e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a</serial>
Nov 19 15:02:18 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:02:18 user nova-compute[74934]: </disk>
Nov 19 15:02:18 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:02:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully detached device vdb from instance 78b81733-fd30-4009-9945-0c34c3b88fbe from the persistent domain config.
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78b81733-fd30-4009-9945-0c34c3b88fbe from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:02:18 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:02:18 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:02:18 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:02:18 user nova-compute[74934]:   <serial>e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a</serial>
Nov 19 15:02:18 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:02:18 user nova-compute[74934]: </disk>
Nov 19 15:02:18 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updated VIF entry in instance network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-78eaa9af-d367-4467-903c-f870f87060ad req-a6b467ac-dfe6-4e4e-9d9f-78d682a8b9e3 service nova] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:02:20 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 is timed out.
Nov 19 15:02:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully detached device vdb from instance 98c746cb-1a7a-4a76-b497-e803dfa7be71 from the live domain config.
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYSWgrbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:02:20 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2a844b-f4e4-4c69-b6b7-ee9a51ce55e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:02:20 user nova-compute[74934]: No targets found.
Nov 19 15:02:20 user nova-compute[74934]: iSNS:
Nov 19 15:02:20 user nova-compute[74934]: No targets found.
Nov 19 15:02:20 user nova-compute[74934]: STATIC:
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524
Nov 19 15:02:20 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:20 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:20 user nova-compute[74934]: FIRMWARE:
Nov 19 15:02:20 user nova-compute[74934]: No targets found.
Nov 19 15:02:20 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:02:20 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:02:20 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47ebb4-ce93-4f54-bb82-2c02694aab3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing instance network info cache due to event network-changed-7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] Acquiring lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] Acquired lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Refreshing network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c89bf0-ee45-42ad-9424-a295c948c54d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd (non-flash)
Nov 19 15:02:20 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 (non-flash)
Nov 19 15:02:20 user nova-compute[74934]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd (non-flash)
Nov 19 15:02:20 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c44211b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524'): ({'sdh'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Removing single pathed devices sdh {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0366e-146a-4bea-b5fa-8a1b5c0ac57c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b0f6f0-46bc-4ad3-a084-bfc00f76dba7]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flushing IO for device /dev/sdh {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.090s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b8c46d-788f-4ad1-a87d-d366cf012657]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a08a33-d192-4513-9fea-09b3ee511080]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] SCSI volumes sdh have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a5429-05eb-4cd6-9a7c-d862e77905c4]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc442fdf-3755-406b-88c8-4b85cad53add]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260]
Nov 19 15:02:20 user nova-compute[74934]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524, portal: 172.16.0.220,3260] successful.
Nov 19 15:02:20 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f717de38-3732-4d88-9688-a53faab53524 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.070s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7a40c6-ffb5-44a8-b65f-53601490a41a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.564s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== disconnect_volume: return (566ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updated VIF entry in instance network info cache for port 7a10bd8e-6da2-4738-8c7d-074dfeee726f. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [{"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c00a953b-4259-4d1f-8b90-3e936e946c0d req-f22a93cd-18d4-4c54-acbb-cdd82efe24ad service nova] Releasing lock "refresh_cache-78b81733-fd30-4009-9945-0c34c3b88fbe" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:02:21 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid 98c746cb-1a7a-4a76-b497-e803dfa7be71 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f0db27f4-be1a-4e95-b271-1bac8ed254b9 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.333s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c1e28e7-4514-4443-b365-da62a85bbc0f is timed out.
Nov 19 15:02:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully detached device vdb from instance 3c1e28e7-4514-4443-b365-da62a85bbc0f from the live domain config.
Nov 19 15:02:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEYlGKBz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:02:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c45ac8-14e5-496c-9c94-c9189c4c1343]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:02:26 user nova-compute[74934]: No targets found.
Nov 19 15:02:26 user nova-compute[74934]: iSNS:
Nov 19 15:02:26 user nova-compute[74934]: No targets found.
Nov 19 15:02:26 user nova-compute[74934]: STATIC:
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 15:02:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:26 user nova-compute[74934]: FIRMWARE:
Nov 19 15:02:26 user nova-compute[74934]: No targets found.
Nov 19 15:02:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:02:26 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:02:26 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[444ab157-f4d7-4c86-840e-eaeb6e0b2a11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.099s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0385cf-2c4d-4d19-9de1-ccb860a06e1a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd (non-flash)
Nov 19 15:02:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:02:26 user nova-compute[74934]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dae0806c-6d34-435c-a8b6-c635e4c07bfd (non-flash)
Nov 19 15:02:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c424dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b'): ({'sdg'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Removing single pathed devices sdg {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59819e-f796-44d1-88ea-893debe4453f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eba75e-ff39-4ddb-9275-33678c1112b5]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Flushing IO for device /dev/sdg {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f04e61-2fd1-4d11-9d8e-0f8e32649eb5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b76b204-9621-4da3-88ca-58f71239124c]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe418f81-9516-475f-99fa-1677f81cfaa2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c8a48-f047-4f00-b1e5-7a4aa7777c1a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260]
Nov 19 15:02:26 user nova-compute[74934]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b, portal: 172.16.0.220,3260] successful.
Nov 19 15:02:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:278aeff5-5107-476f-8471-9c0bcf58954b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ffb328-36aa-4695-aecd-f1bb51008085]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.499s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] <== disconnect_volume: return (500ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:02:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:02:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'flavor' on Instance uuid 3c1e28e7-4514-4443-b365-da62a85bbc0f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-429448ea-de01-4d09-91d0-7bf53093630f tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.700s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:39 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78b81733-fd30-4009-9945-0c34c3b88fbe is timed out.
Nov 19 15:02:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully detached device vdb from instance 78b81733-fd30-4009-9945-0c34c3b88fbe from the live domain config.
Nov 19 15:02:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubcGTeLp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:02:39 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e90af-bcef-4312-b24a-c88d7e331dc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:02:39 user nova-compute[74934]: No targets found.
Nov 19 15:02:39 user nova-compute[74934]: iSNS:
Nov 19 15:02:39 user nova-compute[74934]: No targets found.
Nov 19 15:02:39 user nova-compute[74934]: STATIC:
Nov 19 15:02:39 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:02:39 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:39 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:39 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a
Nov 19 15:02:39 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:39 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:39 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:02:39 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:39 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:39 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:02:39 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:39 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:39 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 15:02:39 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:02:39 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:02:39 user nova-compute[74934]: FIRMWARE:
Nov 19 15:02:39 user nova-compute[74934]: No targets found.
Nov 19 15:02:39 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:02:39 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:02:39 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93f7300-e116-4859-b76a-abcc8b0aeed0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9498f5c7-5da3-41c3-918e-97cad44ad39d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:02:39 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:02:39 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:02:39 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c424f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24375686-8a9b-4ae1-bdf2-6eaf2445b865]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c468337-5045-4ae3-8566-6245092217f8]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be61b7b-7bed-4e24-befd-7ce2389c05c2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d46e32-b779-4e29-80e9-77224850f0e3]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a608e3-efba-455c-adef-159e620ba145]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb5d3d-557a-456d-a574-b7411cbceab9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260]
Nov 19 15:02:39 user nova-compute[74934]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a, portal: 172.16.0.220,3260] successful.
Nov 19 15:02:39 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9da7fe6-1f64-47ae-b7c4-3d6baaa3663a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d275f-e079-438c-8593-8868ae2d1fca]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] <== disconnect_volume: return (330ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:02:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:02:40 user nova-compute[74934]: DEBUG nova.objects.instance [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'flavor' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-21519dc8-3f2a-4839-badd-ff8489a667d6 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:49 user nova-compute[74934]: INFO nova.compute.manager [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Terminating instance
Nov 19 15:02:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-ffdeb32d-b1ec-401b-b372-9e53fd423810 req-c13e8f3a-b770-4678-90e6-40029473af5c service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-vif-unplugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ffdeb32d-b1ec-401b-b372-9e53fd423810 req-c13e8f3a-b770-4678-90e6-40029473af5c service nova] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ffdeb32d-b1ec-401b-b372-9e53fd423810 req-c13e8f3a-b770-4678-90e6-40029473af5c service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ffdeb32d-b1ec-401b-b372-9e53fd423810 req-c13e8f3a-b770-4678-90e6-40029473af5c service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-ffdeb32d-b1ec-401b-b372-9e53fd423810 req-c13e8f3a-b770-4678-90e6-40029473af5c service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] No waiting events found dispatching network-vif-unplugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-ffdeb32d-b1ec-401b-b372-9e53fd423810 req-c13e8f3a-b770-4678-90e6-40029473af5c service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-vif-unplugged-e577961b-b83a-4b35-9599-a725cbb19690 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:50 user nova-compute[74934]: INFO nova.compute.manager [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Terminating instance
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Instance destroyed successfully.
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'resources' on Instance uuid 98c746cb-1a7a-4a76-b497-e803dfa7be71 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-721035766',display_name='tempest-AttachVolumeNegativeTest-server-721035766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-721035766',id=35,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGROgSNYoNAznrrpFYotWW6dQA8qWdd7Y5Z5gNR6PKUOsMEg5ZKnlKa8DfwjOJ3OMTOI6itoYS8JlQ/+Gw/eVRr64pxs3uo8E9lZdDVidLH29tzRTW6MIoDh7Ojx6I+SIA==',key_name='tempest-keypair-509303060',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-h5f3evy5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:00:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=98c746cb-1a7a-4a76-b497-e803dfa7be71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "e577961b-b83a-4b35-9599-a725cbb19690", "address": "fa:16:3e:ed:c9:4f", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape577961b-b8", "ovs_interfaceid": "e577961b-b83a-4b35-9599-a725cbb19690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG os_vif [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape577961b-b8, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17dce486-53e3-4fed-9056-b14145da31ad) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: INFO os_vif [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:4f,bridge_name='br-int',has_traffic_filtering=True,id=e577961b-b83a-4b35-9599-a725cbb19690,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape577961b-b8')
Nov 19 15:02:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Deleting instance files /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71_del
Nov 19 15:02:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Deletion of /opt/stack/data/nova/instances/98c746cb-1a7a-4a76-b497-e803dfa7be71_del complete
Nov 19 15:02:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:50 user nova-compute[74934]: INFO nova.compute.manager [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 19 15:02:50 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:02:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:02:51 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Instance destroyed successfully.
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.objects.instance [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'resources' on Instance uuid 32eaf46a-1013-456e-9c2c-9f8805a53e20 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2078832358',display_name='tempest-AttachVolumeTestJSON-server-2078832358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2078832358',id=20,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnoknF9H9WBomq5BzZTpPFoxrCT91eo8IdQUyNek0nazUOzq4onISE24KlpgfHi4HDy/iAkXIvikJnQ4Qy6sd+Ah6kF9N8biHCfaqsR7eVwoKZnhS82/8AGotJI0TqcFw==',key_name='tempest-keypair-1508350101',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-6liodfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=32eaf46a-1013-456e-9c2c-9f8805a53e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "f4e5537c-702b-445b-a266-44da04a6747d", "address": "fa:16:3e:81:ed:9b", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e5537c-70", "ovs_interfaceid": "f4e5537c-702b-445b-a266-44da04a6747d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG os_vif [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e5537c-70, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0f70efe-2332-495c-8f86-4e48c61f71d7) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:51 user nova-compute[74934]: INFO os_vif [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ed:9b,bridge_name='br-int',has_traffic_filtering=True,id=f4e5537c-702b-445b-a266-44da04a6747d,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e5537c-70')
Nov 19 15:02:51 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Deleting instance files /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20_del
Nov 19 15:02:51 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Deletion of /opt/stack/data/nova/instances/32eaf46a-1013-456e-9c2c-9f8805a53e20_del complete
Nov 19 15:02:51 user nova-compute[74934]: INFO nova.compute.manager [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 19 15:02:51 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:51 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Took 1.06 seconds to deallocate network for instance.
Nov 19 15:02:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-49e91cc2-56b5-4074-9857-23e9ebbb8b40 req-d75b2f71-19f4-487c-b4d4-354e8ea51d51 service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-vif-deleted-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received event network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Acquiring lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] No waiting events found dispatching network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:52 user nova-compute[74934]: WARNING nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 98c746cb-1a7a-4a76-b497-e803dfa7be71] Received unexpected event network-vif-plugged-e577961b-b83a-4b35-9599-a725cbb19690 for instance with vm_state deleted and task_state None.
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-unplugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Acquiring lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] No waiting events found dispatching network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:52 user nova-compute[74934]: WARNING nova.compute.manager [req-c7760a2b-23d7-49f8-8cfa-2d769730b073 req-fe2a2d29-ee5a-4132-a885-eeabde74259c service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received unexpected event network-vif-plugged-f4e5537c-702b-445b-a266-44da04a6747d for instance with vm_state active and task_state deleting.
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:02:52 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Took 1.14 seconds to deallocate network for instance.
Nov 19 15:02:52 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Deleted allocations for instance 98c746cb-1a7a-4a76-b497-e803dfa7be71
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bca56347-25e4-43f1-af0c-466e088d97b5 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "98c746cb-1a7a-4a76-b497-e803dfa7be71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.740s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:52 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Deleted allocations for instance 32eaf46a-1013-456e-9c2c-9f8805a53e20
Nov 19 15:02:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-840c5ec3-efef-44f8-9443-7e20be71f1cd tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "32eaf46a-1013-456e-9c2c-9f8805a53e20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.716s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-fd5fae13-5295-4cf5-adf0-cc2fa25e9ea2 req-bddb46c8-615f-47e0-a1c4-e687c6669888 service nova] [instance: 32eaf46a-1013-456e-9c2c-9f8805a53e20] Received event network-vif-deleted-f4e5537c-702b-445b-a266-44da04a6747d {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:55 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:59 user nova-compute[74934]: INFO nova.compute.manager [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Terminating instance
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-e917e414-c3fe-4268-b20c-061047f02ccd req-d71c450d-3c41-4d5f-ae80-0fbba223a66c service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-unplugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e917e414-c3fe-4268-b20c-061047f02ccd req-d71c450d-3c41-4d5f-ae80-0fbba223a66c service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e917e414-c3fe-4268-b20c-061047f02ccd req-d71c450d-3c41-4d5f-ae80-0fbba223a66c service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e917e414-c3fe-4268-b20c-061047f02ccd req-d71c450d-3c41-4d5f-ae80-0fbba223a66c service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-e917e414-c3fe-4268-b20c-061047f02ccd req-d71c450d-3c41-4d5f-ae80-0fbba223a66c service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-unplugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-e917e414-c3fe-4268-b20c-061047f02ccd req-d71c450d-3c41-4d5f-ae80-0fbba223a66c service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-unplugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:02:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Instance destroyed successfully.
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lazy-loading 'resources' on Instance uuid 3c1e28e7-4514-4443-b365-da62a85bbc0f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-483511959',display_name='tempest-TestMinimumBasicScenario-server-483511959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-483511959',id=31,image_ref='ccdf6a89-114b-4a9d-9733-9d7141a7693d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf5t/KNsPvi0AIviSihOMyVCGfq4jq+K+uCpT59aA/jxffE1fGE97WdYHzdeqj9h8jmKslK9A7Zqk8AmP4XKkp0bXUb1TUuqWonbdBgLYb6WaDyB36QisEtykP/UcLxtA==',key_name='tempest-TestMinimumBasicScenario-1561140614',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11f5e39f366f4f78aa258740eb0f0fae',ramdisk_id='',reservation_id='r-ocqndmsk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ccdf6a89-114b-4a9d-9733-9d7141a7693d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2055579736',owner_user_name='tempest-TestMinimumBasicScenario-2055579736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:00:20Z,user_data=None,user_id='6c76ed73a0da4b2f8b6cf6022eb357d6',uuid=3c1e28e7-4514-4443-b365-da62a85bbc0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converting VIF {"id": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "address": "fa:16:3e:e7:52:44", "network": {"id": "2e6b7f57-daee-44a1-9e02-95d39ff69a92", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-562275189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11f5e39f366f4f78aa258740eb0f0fae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4770ca31-6e", "ovs_interfaceid": "4770ca31-6eb7-4de3-9cf1-c303e9399dd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:02:59 user nova-compute[74934]: DEBUG os_vif [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4770ca31-6e, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac6fbfee-4c9c-4c1b-9e47-8da591937033) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:00 user nova-compute[74934]: INFO os_vif [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:52:44,bridge_name='br-int',has_traffic_filtering=True,id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3,network=Network(2e6b7f57-daee-44a1-9e02-95d39ff69a92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4770ca31-6e')
Nov 19 15:03:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Deleting instance files /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f_del
Nov 19 15:03:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Deletion of /opt/stack/data/nova/instances/3c1e28e7-4514-4443-b365-da62a85bbc0f_del complete
Nov 19 15:03:00 user nova-compute[74934]: INFO nova.compute.manager [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:00 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Took 0.73 seconds to deallocate network for instance.
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-840cdb68-ad66-4ada-a022-1963f3f46e5f req-10e25cf0-d8f1-4fe6-8556-a09c9ba24870 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-deleted-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:00 user nova-compute[74934]: INFO nova.compute.manager [req-840cdb68-ad66-4ada-a022-1963f3f46e5f req-10e25cf0-d8f1-4fe6-8556-a09c9ba24870 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Neutron deleted interface 4770ca31-6eb7-4de3-9cf1-c303e9399dd3; detaching it from the instance and deleting it from the info cache
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.network.neutron [req-840cdb68-ad66-4ada-a022-1963f3f46e5f req-10e25cf0-d8f1-4fe6-8556-a09c9ba24870 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-840cdb68-ad66-4ada-a022-1963f3f46e5f req-10e25cf0-d8f1-4fe6-8556-a09c9ba24870 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Detach interface failed, port_id=4770ca31-6eb7-4de3-9cf1-c303e9399dd3, reason: Instance 3c1e28e7-4514-4443-b365-da62a85bbc0f could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:01 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Deleted allocations for instance 3c1e28e7-4514-4443-b365-da62a85bbc0f
Nov 19 15:03:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-62dc600a-8e77-47bb-8bb8-ad2629e3e0d1 req-ee3f7d6f-0c32-4c74-83f3-702c8d1b5ca1 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62dc600a-8e77-47bb-8bb8-ad2629e3e0d1 req-ee3f7d6f-0c32-4c74-83f3-702c8d1b5ca1 service nova] Acquiring lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62dc600a-8e77-47bb-8bb8-ad2629e3e0d1 req-ee3f7d6f-0c32-4c74-83f3-702c8d1b5ca1 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-62dc600a-8e77-47bb-8bb8-ad2629e3e0d1 req-ee3f7d6f-0c32-4c74-83f3-702c8d1b5ca1 service nova] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-62dc600a-8e77-47bb-8bb8-ad2629e3e0d1 req-ee3f7d6f-0c32-4c74-83f3-702c8d1b5ca1 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] No waiting events found dispatching network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:01 user nova-compute[74934]: WARNING nova.compute.manager [req-62dc600a-8e77-47bb-8bb8-ad2629e3e0d1 req-ee3f7d6f-0c32-4c74-83f3-702c8d1b5ca1 service nova] [instance: 3c1e28e7-4514-4443-b365-da62a85bbc0f] Received unexpected event network-vif-plugged-4770ca31-6eb7-4de3-9cf1-c303e9399dd3 for instance with vm_state deleted and task_state None.
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-335c5d38-3301-495d-b0ec-dfbeb8eab204 tempest-TestMinimumBasicScenario-2055579736 tempest-TestMinimumBasicScenario-2055579736-project-member] Lock "3c1e28e7-4514-4443-b365-da62a85bbc0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:03:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Error from libvirt while getting description of instance-0000001f: [Error Code 42] Domain not found: no domain with matching uuid '3c1e28e7-4514-4443-b365-da62a85bbc0f' (instance-0000001f): libvirt.libvirtError: Domain not found: no domain with matching uuid '3c1e28e7-4514-4443-b365-da62a85bbc0f' (instance-0000001f)
Nov 19 15:03:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:03:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7353MB free_disk=24.85403823852539GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Applying migration context for instance b84f250c-ee76-451f-bf66-68e25842b7e8 as it has an incoming, in-progress migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a. Migration status is finished {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 19 15:03:04 user nova-compute[74934]: INFO nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating resource usage from migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 78b81733-fd30-4009-9945-0c34c3b88fbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e7afb3a2-f158-4399-9fdb-82cdb44362e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:03:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:03:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:03:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [{"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-e7afb3a2-f158-4399-9fdb-82cdb44362e5" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:03:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:09 user nova-compute[74934]: INFO nova.compute.manager [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Terminating instance
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-db0f47e5-8a88-4874-9baa-e05803e956ac req-ab6e2fc3-6859-4127-b57e-9620c55232fb service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-db0f47e5-8a88-4874-9baa-e05803e956ac req-ab6e2fc3-6859-4127-b57e-9620c55232fb service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-db0f47e5-8a88-4874-9baa-e05803e956ac req-ab6e2fc3-6859-4127-b57e-9620c55232fb service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-db0f47e5-8a88-4874-9baa-e05803e956ac req-ab6e2fc3-6859-4127-b57e-9620c55232fb service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-db0f47e5-8a88-4874-9baa-e05803e956ac req-ab6e2fc3-6859-4127-b57e-9620c55232fb service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-db0f47e5-8a88-4874-9baa-e05803e956ac req-ab6e2fc3-6859-4127-b57e-9620c55232fb service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-unplugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Instance destroyed successfully.
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'resources' on Instance uuid 78b81733-fd30-4009-9945-0c34c3b88fbe {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-521385301',display_name='tempest-ServerRescueNegativeTestJSON-server-521385301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-521385301',id=29,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU25u6vlQLM4pT/EdPPLpw7XpBuyzy9Dan9CS0/h4hAKePRDZULoDhSjuLEkrX/OP3672WGh+4bUlDJsQS6bbquprDIJ6TvTyIKhMuKUoRqIQLytBgS3VE83Q5EPBB/sA==',key_name='tempest-keypair-1812534498',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:58:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-gdyhmcqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=78b81733-fd30-4009-9945-0c34c3b88fbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "address": "fa:16:3e:bd:0a:7a", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a10bd8e-6d", "ovs_interfaceid": "7a10bd8e-6da2-4738-8c7d-074dfeee726f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG os_vif [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a10bd8e-6d, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11969015-fd2c-41c6-b148-f4071b0710c9) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:09 user nova-compute[74934]: INFO os_vif [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:0a:7a,bridge_name='br-int',has_traffic_filtering=True,id=7a10bd8e-6da2-4738-8c7d-074dfeee726f,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a10bd8e-6d')
Nov 19 15:03:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Deleting instance files /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe_del
Nov 19 15:03:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Deletion of /opt/stack/data/nova/instances/78b81733-fd30-4009-9945-0c34c3b88fbe_del complete
Nov 19 15:03:09 user nova-compute[74934]: INFO nova.compute.manager [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 19 15:03:09 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:03:09 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:03:10 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:10 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Took 1.02 seconds to deallocate network for instance.
Nov 19 15:03:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] Acquiring lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] No waiting events found dispatching network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:11 user nova-compute[74934]: WARNING nova.compute.manager [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received unexpected event network-vif-plugged-7a10bd8e-6da2-4738-8c7d-074dfeee726f for instance with vm_state deleted and task_state None.
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.compute.manager [req-2ef3a171-1786-434e-b6a8-2319a7fb3a60 req-afa058de-34c3-4aaf-8b59-32be159ca782 service nova] [instance: 78b81733-fd30-4009-9945-0c34c3b88fbe] Received event network-vif-deleted-7a10bd8e-6da2-4738-8c7d-074dfeee726f {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:11 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Deleted allocations for instance 78b81733-fd30-4009-9945-0c34c3b88fbe
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Going to confirm migration 2 {{(pid=74934) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ec854d1b-4d6d-40e1-91cf-d83be99fd46e tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "78b81733-fd30-4009-9945-0c34c3b88fbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.580s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquired lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:03:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'info_cache' on Instance uuid b84f250c-ee76-451f-bf66-68e25842b7e8 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [{"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Releasing lock "refresh_cache-b84f250c-ee76-451f-bf66-68e25842b7e8" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'migration_context' on Instance uuid b84f250c-ee76-451f-bf66-68e25842b7e8 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG nova.objects.base [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Object Instance<b84f250c-ee76-451f-bf66-68e25842b7e8> lazy-loaded attributes: info_cache,migration_context {{(pid=74934) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.452s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:13 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Deleted allocation for migration 6218991e-2d21-4acf-acd8-b1f86ac6c33a
Nov 19 15:03:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e855a691-967a-43c8-aa59-34eeda41cf4c tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.648s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:16 user nova-compute[74934]: INFO nova.compute.manager [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Unrescuing
Nov 19 15:03:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquired lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:03:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating instance_info_cache with network_info: [{"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Releasing lock "refresh_cache-069f95a6-6e49-4054-baf6-7da3d23c0514" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:16 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'flavor' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-c8f5d610-8e04-43fc-9ff8-c62737fbc8b6 req-67c5a55a-b77e-434a-a2bc-f2b49bdb9971 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c8f5d610-8e04-43fc-9ff8-c62737fbc8b6 req-67c5a55a-b77e-434a-a2bc-f2b49bdb9971 service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c8f5d610-8e04-43fc-9ff8-c62737fbc8b6 req-67c5a55a-b77e-434a-a2bc-f2b49bdb9971 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c8f5d610-8e04-43fc-9ff8-c62737fbc8b6 req-67c5a55a-b77e-434a-a2bc-f2b49bdb9971 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-c8f5d610-8e04-43fc-9ff8-c62737fbc8b6 req-67c5a55a-b77e-434a-a2bc-f2b49bdb9971 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:17 user nova-compute[74934]: WARNING nova.compute.manager [req-c8f5d610-8e04-43fc-9ff8-c62737fbc8b6 req-67c5a55a-b77e-434a-a2bc-f2b49bdb9971 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:03:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance destroyed successfully.
Nov 19 15:03:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-9006a451-5a19-43bc-8ee9-e536412a8f37 req-a2d4bb3d-66a2-4dd8-a796-c2f198d4f74d service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9006a451-5a19-43bc-8ee9-e536412a8f37 req-a2d4bb3d-66a2-4dd8-a796-c2f198d4f74d service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9006a451-5a19-43bc-8ee9-e536412a8f37 req-a2d4bb3d-66a2-4dd8-a796-c2f198d4f74d service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9006a451-5a19-43bc-8ee9-e536412a8f37 req-a2d4bb3d-66a2-4dd8-a796-c2f198d4f74d service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-9006a451-5a19-43bc-8ee9-e536412a8f37 req-a2d4bb3d-66a2-4dd8-a796-c2f198d4f74d service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:19 user nova-compute[74934]: WARNING nova.compute.manager [req-9006a451-5a19-43bc-8ee9-e536412a8f37 req-a2d4bb3d-66a2-4dd8-a796-c2f198d4f74d service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:03:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:21 user nova-compute[74934]: WARNING nova.compute.manager [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:03:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:21 user nova-compute[74934]: WARNING nova.compute.manager [req-47c0a5f6-513c-4e05-afda-6ce2768f2a73 req-bde71e88-52eb-4e00-bcb0-8864dfac18cd service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state rescued and task_state unrescuing.
Nov 19 15:03:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c1458e3c-b305-4a81-a2e9-019364e3e9ad tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:03:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:03:44 user nova-compute[74934]: INFO nova.compute.claims [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Claim successful on node user
Nov 19 15:03:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.343s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:03:45 user nova-compute[74934]: INFO nova.compute.claims [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Claim successful on node user
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.network.neutron [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:03:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.policy [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124c5ebfa08e42e49e2e9d244103a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8926ff675c045458069f7b4e1ebc656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:03:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Creating image(s)
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "/opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "/opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:45 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.208s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk 1073741824" returned: 0 in 0.076s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.network.neutron [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.network.neutron [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Successfully created port: 80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:03:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Creating image(s)
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "/opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "/opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "/opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.policy [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eda5707b8cd7412098e9d0b3e4bdc536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd008f473dc744a9bc9f1ebc2f4cb95d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Cannot resize image /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Ensure instance console log exists: /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk 1073741824" returned: 0 in 0.055s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Cannot resize image /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Ensure instance console log exists: /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Successfully updated port: 80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquired lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Successfully created port: 8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-changed-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Refreshing instance network info cache due to event network-changed-80b59d4a-d7d6-4adb-8124-083498d14e16. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] Acquiring lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updating instance_info_cache with network_info: [{"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Releasing lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Instance network_info: |[{"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] Acquired lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.neutron [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Refreshing network info cache for port 80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Start _get_guest_xml network_info=[{"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:03:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:03:48 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1565667026',display_name='tempest-AttachVolumeNegativeTest-server-1565667026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1565667026',id=37,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqJ9P8MX6aXTrvZDVxJs2fx2jLN9MNUzXeF/IJ4DBl3UmFVidGdxOpVffJ+QCP5AaWyIam7M67wsd3+DKf5qZrlatGSyAgN8dNB/NCP3VGDJ/Cy6xcmBerbCVCSiGg2g==',key_name='tempest-keypair-995377627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-o1i9wqe0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=39aaebaa-b445-4860-87db-34a835082d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'pci_devices' on Instance uuid 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:03:48 user nova-compute[74934]:   <uuid>39aaebaa-b445-4860-87db-34a835082d28</uuid>
Nov 19 15:03:48 user nova-compute[74934]:   <name>instance-00000025</name>
Nov 19 15:03:48 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:03:48 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:03:48 user nova-compute[74934]:   <metadata>
Nov 19 15:03:48 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:03:48 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:03:48 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1565667026</nova:name>
Nov 19 15:03:48 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:03:48</nova:creationTime>
Nov 19 15:03:48 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:03:48 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:03:48 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:03:48 user nova-compute[74934]:       <nova:owner>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:user uuid="124c5ebfa08e42e49e2e9d244103a1f4">tempest-AttachVolumeNegativeTest-661612303-project-member</nova:user>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:project uuid="a8926ff675c045458069f7b4e1ebc656">tempest-AttachVolumeNegativeTest-661612303</nova:project>
Nov 19 15:03:48 user nova-compute[74934]:       </nova:owner>
Nov 19 15:03:48 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:03:48 user nova-compute[74934]:       <nova:ports>
Nov 19 15:03:48 user nova-compute[74934]:         <nova:port uuid="80b59d4a-d7d6-4adb-8124-083498d14e16">
Nov 19 15:03:48 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 19 15:03:48 user nova-compute[74934]:         </nova:port>
Nov 19 15:03:48 user nova-compute[74934]:       </nova:ports>
Nov 19 15:03:48 user nova-compute[74934]:     </nova:instance>
Nov 19 15:03:48 user nova-compute[74934]:   </metadata>
Nov 19 15:03:48 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:03:48 user nova-compute[74934]:     <system>
Nov 19 15:03:48 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:03:48 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:03:48 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:03:48 user nova-compute[74934]:       <entry name="serial">39aaebaa-b445-4860-87db-34a835082d28</entry>
Nov 19 15:03:48 user nova-compute[74934]:       <entry name="uuid">39aaebaa-b445-4860-87db-34a835082d28</entry>
Nov 19 15:03:48 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:03:48 user nova-compute[74934]:     </system>
Nov 19 15:03:48 user nova-compute[74934]:   </sysinfo>
Nov 19 15:03:48 user nova-compute[74934]:   <os>
Nov 19 15:03:48 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:03:48 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:03:48 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:03:48 user nova-compute[74934]:   </os>
Nov 19 15:03:48 user nova-compute[74934]:   <features>
Nov 19 15:03:48 user nova-compute[74934]:     <acpi/>
Nov 19 15:03:48 user nova-compute[74934]:     <apic/>
Nov 19 15:03:48 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:03:48 user nova-compute[74934]:   </features>
Nov 19 15:03:48 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:03:48 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:03:48 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:03:48 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:03:48 user nova-compute[74934]:   </clock>
Nov 19 15:03:48 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:03:48 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:03:48 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:03:48 user nova-compute[74934]:   </cpu>
Nov 19 15:03:48 user nova-compute[74934]:   <devices>
Nov 19 15:03:48 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:03:48 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:03:48 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk"/>
Nov 19 15:03:48 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:03:48 user nova-compute[74934]:     </disk>
Nov 19 15:03:48 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:03:48 user nova-compute[74934]:       <mac address="fa:16:3e:39:00:18"/>
Nov 19 15:03:48 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:03:48 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:03:48 user nova-compute[74934]:       <target dev="tap80b59d4a-d7"/>
Nov 19 15:03:48 user nova-compute[74934]:     </interface>
Nov 19 15:03:48 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:03:48 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/console.log" append="off"/>
Nov 19 15:03:48 user nova-compute[74934]:     </serial>
Nov 19 15:03:48 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:03:48 user nova-compute[74934]:     <video>
Nov 19 15:03:48 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:03:48 user nova-compute[74934]:     </video>
Nov 19 15:03:48 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:03:48 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:03:48 user nova-compute[74934]:     </rng>
Nov 19 15:03:48 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:03:48 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:03:48 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:03:48 user nova-compute[74934]:     </memballoon>
Nov 19 15:03:48 user nova-compute[74934]:   </devices>
Nov 19 15:03:48 user nova-compute[74934]: </domain>
Nov 19 15:03:48 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1565667026',display_name='tempest-AttachVolumeNegativeTest-server-1565667026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1565667026',id=37,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqJ9P8MX6aXTrvZDVxJs2fx2jLN9MNUzXeF/IJ4DBl3UmFVidGdxOpVffJ+QCP5AaWyIam7M67wsd3+DKf5qZrlatGSyAgN8dNB/NCP3VGDJ/Cy6xcmBerbCVCSiGg2g==',key_name='tempest-keypair-995377627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-o1i9wqe0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=39aaebaa-b445-4860-87db-34a835082d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG os_vif [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36ec7f85-6c0a-55ce-a499-d8d56641d11f', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80b59d4a-d7, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80b59d4a-d7, col_values=(('qos', UUID('7a229768-7478-4642-a337-efcf290b9014')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80b59d4a-d7, col_values=(('external_ids', {'iface-id': '80b59d4a-d7d6-4adb-8124-083498d14e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:00:18', 'vm-uuid': '39aaebaa-b445-4860-87db-34a835082d28'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:49 user nova-compute[74934]: INFO os_vif [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7')
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:39:00:18, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updated VIF entry in instance network info cache for port 80b59d4a-d7d6-4adb-8124-083498d14e16. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updating instance_info_cache with network_info: [{"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ee56718b-d3cd-4daa-8dd7-94271c0d86b5 req-45a8c955-0b12-4a1d-a78e-4e6a2b762f21 service nova] Releasing lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Successfully updated port: 8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquired lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updating instance_info_cache with network_info: [{"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Releasing lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Instance network_info: |[{"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Start _get_guest_xml network_info=[{"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:03:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:03:49 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-890737702',display_name='tempest-AttachVolumeTestJSON-server-890737702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-890737702',id=38,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm/c8rap4WTv/paQVBmpEqM/c58nw9FFgabJ3etWQCueVBjk2xe7wvMGUDyvXDaPTLhocn3E9RG1tqa6ZaLixyPMw/VJf3K6G0OpXejiB5wJayBk2fSKTA44JwchvllVQ==',key_name='tempest-keypair-364835346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-d11dxfoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=920e8234-66a1-43a8-bc6a-b3a4d31341c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'pci_devices' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:03:49 user nova-compute[74934]:   <uuid>920e8234-66a1-43a8-bc6a-b3a4d31341c2</uuid>
Nov 19 15:03:49 user nova-compute[74934]:   <name>instance-00000026</name>
Nov 19 15:03:49 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:03:49 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:03:49 user nova-compute[74934]:   <metadata>
Nov 19 15:03:49 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:03:49 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:03:49 user nova-compute[74934]:       <nova:name>tempest-AttachVolumeTestJSON-server-890737702</nova:name>
Nov 19 15:03:49 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:03:49</nova:creationTime>
Nov 19 15:03:49 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:03:49 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:03:49 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:03:49 user nova-compute[74934]:       <nova:owner>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:user uuid="eda5707b8cd7412098e9d0b3e4bdc536">tempest-AttachVolumeTestJSON-980904147-project-member</nova:user>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:project uuid="cd008f473dc744a9bc9f1ebc2f4cb95d">tempest-AttachVolumeTestJSON-980904147</nova:project>
Nov 19 15:03:49 user nova-compute[74934]:       </nova:owner>
Nov 19 15:03:49 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:03:49 user nova-compute[74934]:       <nova:ports>
Nov 19 15:03:49 user nova-compute[74934]:         <nova:port uuid="8ad1b074-aba2-4905-943d-5694480f9631">
Nov 19 15:03:49 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 19 15:03:49 user nova-compute[74934]:         </nova:port>
Nov 19 15:03:49 user nova-compute[74934]:       </nova:ports>
Nov 19 15:03:49 user nova-compute[74934]:     </nova:instance>
Nov 19 15:03:49 user nova-compute[74934]:   </metadata>
Nov 19 15:03:49 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:03:49 user nova-compute[74934]:     <system>
Nov 19 15:03:49 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:03:49 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:03:49 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:03:49 user nova-compute[74934]:       <entry name="serial">920e8234-66a1-43a8-bc6a-b3a4d31341c2</entry>
Nov 19 15:03:49 user nova-compute[74934]:       <entry name="uuid">920e8234-66a1-43a8-bc6a-b3a4d31341c2</entry>
Nov 19 15:03:49 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:03:49 user nova-compute[74934]:     </system>
Nov 19 15:03:49 user nova-compute[74934]:   </sysinfo>
Nov 19 15:03:49 user nova-compute[74934]:   <os>
Nov 19 15:03:49 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:03:49 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:03:49 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:03:49 user nova-compute[74934]:   </os>
Nov 19 15:03:49 user nova-compute[74934]:   <features>
Nov 19 15:03:49 user nova-compute[74934]:     <acpi/>
Nov 19 15:03:49 user nova-compute[74934]:     <apic/>
Nov 19 15:03:49 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:03:49 user nova-compute[74934]:   </features>
Nov 19 15:03:49 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:03:49 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:03:49 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:03:49 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:03:49 user nova-compute[74934]:   </clock>
Nov 19 15:03:49 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:03:49 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:03:49 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:03:49 user nova-compute[74934]:   </cpu>
Nov 19 15:03:49 user nova-compute[74934]:   <devices>
Nov 19 15:03:49 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:03:49 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:03:49 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk"/>
Nov 19 15:03:49 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:03:49 user nova-compute[74934]:     </disk>
Nov 19 15:03:49 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:03:49 user nova-compute[74934]:       <mac address="fa:16:3e:3d:a0:7f"/>
Nov 19 15:03:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:03:49 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:03:49 user nova-compute[74934]:       <target dev="tap8ad1b074-ab"/>
Nov 19 15:03:49 user nova-compute[74934]:     </interface>
Nov 19 15:03:49 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:03:49 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/console.log" append="off"/>
Nov 19 15:03:49 user nova-compute[74934]:     </serial>
Nov 19 15:03:49 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:03:49 user nova-compute[74934]:     <video>
Nov 19 15:03:49 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:03:49 user nova-compute[74934]:     </video>
Nov 19 15:03:49 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:03:49 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:03:49 user nova-compute[74934]:     </rng>
Nov 19 15:03:49 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:03:49 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:03:49 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:03:49 user nova-compute[74934]:     </memballoon>
Nov 19 15:03:49 user nova-compute[74934]:   </devices>
Nov 19 15:03:49 user nova-compute[74934]: </domain>
Nov 19 15:03:49 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-890737702',display_name='tempest-AttachVolumeTestJSON-server-890737702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-890737702',id=38,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm/c8rap4WTv/paQVBmpEqM/c58nw9FFgabJ3etWQCueVBjk2xe7wvMGUDyvXDaPTLhocn3E9RG1tqa6ZaLixyPMw/VJf3K6G0OpXejiB5wJayBk2fSKTA44JwchvllVQ==',key_name='tempest-keypair-364835346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-d11dxfoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=920e8234-66a1-43a8-bc6a-b3a4d31341c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG os_vif [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66177aa7-e16b-5ebd-91d2-9ee89f7dc159', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ad1b074-ab, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ad1b074-ab, col_values=(('qos', UUID('1e982ed6-2e29-4988-b3f3-fff8c683b101')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ad1b074-ab, col_values=(('external_ids', {'iface-id': '8ad1b074-aba2-4905-943d-5694480f9631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:a0:7f', 'vm-uuid': '920e8234-66a1-43a8-bc6a-b3a4d31341c2'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: INFO os_vif [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab')
Nov 19 15:03:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No VIF found with MAC fa:16:3e:3d:a0:7f, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-changed-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Refreshing instance network info cache due to event network-changed-8ad1b074-aba2-4905-943d-5694480f9631. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] Acquiring lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] Acquired lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Refreshing network info cache for port 8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:03:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG nova.network.neutron [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updated VIF entry in instance network info cache for port 8ad1b074-aba2-4905-943d-5694480f9631. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG nova.network.neutron [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updating instance_info_cache with network_info: [{"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8fd8bdc3-bff7-4e1e-944e-886b1646a27d req-7a722fac-4f5e-457a-88b3-99addeca0c42 service nova] Releasing lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-changed-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Refreshing instance network info cache due to event network-changed-09874d1f-26ee-47a8-962d-3aeba7286674. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] Acquiring lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] Acquired lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.network.neutron [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Refreshing network info cache for port 09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] No waiting events found dispatching network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:52 user nova-compute[74934]: WARNING nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received unexpected event network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 for instance with vm_state building and task_state spawning.
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] No waiting events found dispatching network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:52 user nova-compute[74934]: WARNING nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received unexpected event network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 for instance with vm_state building and task_state spawning.
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] No waiting events found dispatching network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:52 user nova-compute[74934]: WARNING nova.compute.manager [req-fc753d53-75ac-440e-a9e7-52a43675773f req-7d51b097-0cab-481a-9a98-8bfc8e85fce0 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received unexpected event network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 for instance with vm_state building and task_state spawning.
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:52 user nova-compute[74934]: INFO nova.compute.manager [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Terminating instance
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG nova.objects.instance [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'flavor' on Instance uuid edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:52 user nova-compute[74934]: INFO nova.compute.manager [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Attaching volume f403cb43-2163-4e81-b8a4-f19ab35dedbe to /dev/vdb
Nov 19 15:03:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.utils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d22b3-9a1f-464b-bd48-13a7c1bcdb69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a98c34-7d85-42a5-baec-16c39d7e60c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24c7a18-136d-42dc-884e-d33dc9b9a3e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b5aaf8-345b-48a8-9745-f4a36d4f6628]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updated VIF entry in instance network info cache for port 09874d1f-26ee-47a8-962d-3aeba7286674. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating instance_info_cache with network_info: [{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:03:53 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6634e-689a-40aa-861f-a527ade1e871]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.utils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating existing volume attachment record: 0754161e-e570-470d-a4fa-a9ffc8259641 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-76717062-83e3-43ce-acdb-2ae9e2cf81a7 req-6a3c9ba9-041a-4496-893a-39ecbfb4ef86 service nova] Releasing lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-bf8fbf38-708f-450f-b15a-527bff08dbdf req-368e7894-c27b-4010-9f5d-8220d151eb1e service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bf8fbf38-708f-450f-b15a-527bff08dbdf req-368e7894-c27b-4010-9f5d-8220d151eb1e service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bf8fbf38-708f-450f-b15a-527bff08dbdf req-368e7894-c27b-4010-9f5d-8220d151eb1e service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bf8fbf38-708f-450f-b15a-527bff08dbdf req-368e7894-c27b-4010-9f5d-8220d151eb1e service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-bf8fbf38-708f-450f-b15a-527bff08dbdf req-368e7894-c27b-4010-9f5d-8220d151eb1e service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-bf8fbf38-708f-450f-b15a-527bff08dbdf req-368e7894-c27b-4010-9f5d-8220d151eb1e service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-unplugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:03:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Instance destroyed successfully.
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lazy-loading 'resources' on Instance uuid e7afb3a2-f158-4399-9fdb-82cdb44362e5 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1516657562',display_name='tempest-ServerActionsTestOtherB-server-1516657562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1516657562',id=25,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7fvB1OYDVTewJvtVOImzvjR3MC/+y/4MssSgLV8ZDnRw7rfH1cxswqyHMPhtsrtn1XfYwqt1LXla6WoJ5Ri+OIa/Eqo9LfrsFVUe+WDwEaRza6BZr4B54rBQ3/QfyuSQ==',key_name='tempest-keypair-156341601',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f186c71871084693a14881dce4328b46',ramdisk_id='',reservation_id='r-oagakeff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-868500136',owner_user_name='tempest-ServerActionsTestOtherB-868500136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5935830106b34079a0d046897dac49ba',uuid=e7afb3a2-f158-4399-9fdb-82cdb44362e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converting VIF {"id": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "address": "fa:16:3e:84:28:56", "network": {"id": "16436426-dc8c-4980-b51e-a8ba4f262262", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1934275186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f186c71871084693a14881dce4328b46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f242ee2-4b", "ovs_interfaceid": "6f242ee2-4b9e-4d39-9534-7cf20e355413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_vif [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f242ee2-4b, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ce5aff7-8dec-4c55-9e23-9bbeb76733c9) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:03:53 user nova-compute[74934]: INFO os_vif [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:28:56,bridge_name='br-int',has_traffic_filtering=True,id=6f242ee2-4b9e-4d39-9534-7cf20e355413,network=Network(16436426-dc8c-4980-b51e-a8ba4f262262),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f242ee2-4b')
Nov 19 15:03:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfmkcpXA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:03:53 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df22bea0-1cbf-4168-ac4b-6825cff5c5fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:03:53 user nova-compute[74934]: No targets found.
Nov 19 15:03:53 user nova-compute[74934]: iSNS:
Nov 19 15:03:53 user nova-compute[74934]: No targets found.
Nov 19 15:03:53 user nova-compute[74934]: STATIC:
Nov 19 15:03:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:03:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:03:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:03:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:03:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:03:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:03:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b
Nov 19 15:03:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:03:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:03:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:03:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:03:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:03:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac
Nov 19 15:03:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:03:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:03:53 user nova-compute[74934]: FIRMWARE:
Nov 19 15:03:53 user nova-compute[74934]: No targets found.
Nov 19 15:03:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:03:53 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:03:53 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88e07c6-acfb-4fe2-a01f-ceefd10bf896]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa09c6-7afa-4d78-b75e-23d4dad71d3b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)
Nov 19 15:03:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:03:53 user nova-compute[74934]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)
Nov 19 15:03:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff50351-e2d1-46c8-8a5e-d4891d1d123c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0f105-7aed-4e43-b887-238f4a27dcfd]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1304721e-fce6-4778-bc2a-d0caa8e38b0d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5a96e8-7692-430e-a1f5-d63bec148b36]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3189c805-aac2-43ed-b8b2-d57ef5d048d7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2bd0a8-1399-4eea-8b91-0c3ae7745d5a]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260]
Nov 19 15:03:53 user nova-compute[74934]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac, portal: 172.16.0.220,3260] successful.
Nov 19 15:03:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:03:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fce5e560-3383-4690-9255-8b47f3f361ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b19ba-6b34-4379-8134-84a99fcafd09]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] <== disconnect_volume: return (396ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Deleting instance files /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5_del
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Deletion of /opt/stack/data/nova/instances/e7afb3a2-f158-4399-9fdb-82cdb44362e5_del complete
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.compute.manager [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Instance spawned successfully.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Took 8.77 seconds to spawn the instance on the hypervisor.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.compute.manager [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Took 9.70 seconds to build instance.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-51478086-c91b-419f-a633-9aa2cb1025ee tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.823s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Instance spawned successfully.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-def4a0dc-6d2d-4932-9b10-0c742650c23d req-64b6ceb5-d0dd-4fbe-b8c6-1f9c8d29540b service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-def4a0dc-6d2d-4932-9b10-0c742650c23d req-64b6ceb5-d0dd-4fbe-b8c6-1f9c8d29540b service nova] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-def4a0dc-6d2d-4932-9b10-0c742650c23d req-64b6ceb5-d0dd-4fbe-b8c6-1f9c8d29540b service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-def4a0dc-6d2d-4932-9b10-0c742650c23d req-64b6ceb5-d0dd-4fbe-b8c6-1f9c8d29540b service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-def4a0dc-6d2d-4932-9b10-0c742650c23d req-64b6ceb5-d0dd-4fbe-b8c6-1f9c8d29540b service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] No waiting events found dispatching network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:54 user nova-compute[74934]: WARNING nova.compute.manager [req-def4a0dc-6d2d-4932-9b10-0c742650c23d req-64b6ceb5-d0dd-4fbe-b8c6-1f9c8d29540b service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received unexpected event network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 for instance with vm_state building and task_state spawning.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Took 8.30 seconds to spawn the instance on the hypervisor.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:03:54 user nova-compute[74934]: INFO nova.compute.manager [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Took 9.86 seconds to build instance.
Nov 19 15:03:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-bbf5a82e-761c-4de9-bd8a-e9cccaf7b0b8 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.010s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:03:55 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Took 1.24 seconds to deallocate network for instance.
Nov 19 15:03:55 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-d82c04f6-c8e5-4343-90b6-d3afb400c021 req-1bec43d6-6928-4718-89c9-94587e18df59 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d82c04f6-c8e5-4343-90b6-d3afb400c021 req-1bec43d6-6928-4718-89c9-94587e18df59 service nova] Acquiring lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d82c04f6-c8e5-4343-90b6-d3afb400c021 req-1bec43d6-6928-4718-89c9-94587e18df59 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d82c04f6-c8e5-4343-90b6-d3afb400c021 req-1bec43d6-6928-4718-89c9-94587e18df59 service nova] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-d82c04f6-c8e5-4343-90b6-d3afb400c021 req-1bec43d6-6928-4718-89c9-94587e18df59 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] No waiting events found dispatching network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:03:55 user nova-compute[74934]: WARNING nova.compute.manager [req-d82c04f6-c8e5-4343-90b6-d3afb400c021 req-1bec43d6-6928-4718-89c9-94587e18df59 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received unexpected event network-vif-plugged-6f242ee2-4b9e-4d39-9534-7cf20e355413 for instance with vm_state active and task_state deleting.
Nov 19 15:03:56 user nova-compute[74934]: INFO nova.compute.manager [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Took 0.99 seconds to detach 1 volumes for instance.
Nov 19 15:03:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:56 user nova-compute[74934]: DEBUG nova.compute.manager [req-c2e27e3e-68b4-4cc6-9197-0c9a0cc1dea9 req-d2dac4af-800a-47ce-b2a3-07c729763d95 service nova] [instance: e7afb3a2-f158-4399-9fdb-82cdb44362e5] Received event network-vif-deleted-6f242ee2-4b9e-4d39-9534-7cf20e355413 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:03:56 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:03:56 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:03:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:57 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Deleted allocations for instance e7afb3a2-f158-4399-9fdb-82cdb44362e5
Nov 19 15:03:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1f7e5440-9f3b-40c2-81eb-8eb3789935f7 tempest-ServerActionsTestOtherB-868500136 tempest-ServerActionsTestOtherB-868500136-project-member] Lock "e7afb3a2-f158-4399-9fdb-82cdb44362e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.514s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:03:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMBLrOKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:04:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:04:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:04:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:04:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:04:00 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146ab18-8af0-4fd4-8df2-18c3363ece55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:04:00 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db8a9f-f4be-4294-8f40-e9299c84b3d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe] added
Nov 19 15:04:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaed9dd-a5a1-452f-9c0d-0f4a2901347a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d644755d-13a9-45e6-97c7-8faf2826e61f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eMBLrOKW {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eMBLrOKW" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1011cfef-e43b-4db7-b485-d36a83c26786]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eMBLrOKW'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7212522-a783-424b-ac7f-24fc72cd208d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c946c-c998-43c5-9a0e-d74b8648e97e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5727b9f0-e95f-4da0-95ce-654d08d98de3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5727b9f0-e95f-4da0-95ce-654d08d98de3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5727b9f0-e95f-4da0-95ce-654d08d98de3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c319fa-ac91-456d-8455-1a177285fde7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260]
Nov 19 15:04:01 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260] successful.
Nov 19 15:04:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea229d-b565-4ff6-80e9-f60cb977771c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1393e77-f751-41b6-b1c6-fd38924060ad]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5727b9f0-e95f-4da0-95ce-654d08d98de3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5727b9f0-e95f-4da0-95ce-654d08d98de3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe (non-flash)
Nov 19 15:04:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0481304-20bb-4158-a936-ab21e26b226b (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5727b9f0-e95f-4da0-95ce-654d08d98de3 (non-flash)
Nov 19 15:04:01 user nova-compute[74934]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe (non-flash)
Nov 19 15:04:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.035s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[19058502-d5e8-4c14-81f6-4eba97c1ff9c]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMBLrOKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.580s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] <== connect_volume: return (1586ms) {'type': 'block', 'scsi_wwn': '26536333861313833', 'path': '/dev/sdg'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536333861313833', 'path': '/dev/sdg'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'flavor' on Instance uuid edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:04:02 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:04:02 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 15:04:02 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:04:02 user nova-compute[74934]:   <serial>f403cb43-2163-4e81-b8a4-f19ab35dedbe</serial>
Nov 19 15:04:02 user nova-compute[74934]: </disk>
Nov 19 15:04:02 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No VIF found with MAC fa:16:3e:48:c4:03, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-40949b18-0a4f-4176-86a7-3fe4e2625b2e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.325s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:04:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:04:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7669MB free_disk=24.954669952392578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:04:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ede07940-0d9c-41ce-8d54-8b1d042f4da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 39aaebaa-b445-4860-87db-34a835082d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:04:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.286s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:06 user nova-compute[74934]: INFO nova.compute.manager [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Detaching volume f403cb43-2163-4e81-b8a4-f19ab35dedbe
Nov 19 15:04:06 user nova-compute[74934]: INFO nova.virt.block_device [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Attempting to driver detach volume f403cb43-2163-4e81-b8a4-f19ab35dedbe from mountpoint /dev/vdb
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Attempting to detach device vdb from instance edd37f42-f320-4a31-a4a0-2d0441123a61 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:04:06 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:04:06 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 15:04:06 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:04:06 user nova-compute[74934]:   <serial>f403cb43-2163-4e81-b8a4-f19ab35dedbe</serial>
Nov 19 15:04:06 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:04:06 user nova-compute[74934]: </disk>
Nov 19 15:04:06 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:04:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully detached device vdb from instance edd37f42-f320-4a31-a4a0-2d0441123a61 from the persistent domain config.
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance edd37f42-f320-4a31-a4a0-2d0441123a61 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:04:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:04:06 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:04:06 user nova-compute[74934]:   <source dev="/dev/sdg"/>
Nov 19 15:04:06 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:04:06 user nova-compute[74934]:   <serial>f403cb43-2163-4e81-b8a4-f19ab35dedbe</serial>
Nov 19 15:04:06 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:04:06 user nova-compute[74934]: </disk>
Nov 19 15:04:06 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:07 user nova-compute[74934]: INFO nova.compute.manager [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Terminating instance
Nov 19 15:04:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-73a94dfb-ba13-4f6f-9e57-937ebba13db0 req-c855bfbe-b0ab-4de3-838d-ae14d3bc6ff2 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-unplugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73a94dfb-ba13-4f6f-9e57-937ebba13db0 req-c855bfbe-b0ab-4de3-838d-ae14d3bc6ff2 service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73a94dfb-ba13-4f6f-9e57-937ebba13db0 req-c855bfbe-b0ab-4de3-838d-ae14d3bc6ff2 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-73a94dfb-ba13-4f6f-9e57-937ebba13db0 req-c855bfbe-b0ab-4de3-838d-ae14d3bc6ff2 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-73a94dfb-ba13-4f6f-9e57-937ebba13db0 req-c855bfbe-b0ab-4de3-838d-ae14d3bc6ff2 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-unplugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-73a94dfb-ba13-4f6f-9e57-937ebba13db0 req-c855bfbe-b0ab-4de3-838d-ae14d3bc6ff2 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-unplugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Instance destroyed successfully.
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'resources' on Instance uuid 73f74149-9044-4fd3-b73a-5082a7b0fd86 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998578892',display_name='tempest-ServerRescueNegativeTestJSON-server-998578892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998578892',id=3,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-kp4hnesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:50:00Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=73f74149-9044-4fd3-b73a-5082a7b0fd86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "38fdb168-5074-4b4f-9495-8986af433ea9", "address": "fa:16:3e:70:f9:87", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38fdb168-50", "ovs_interfaceid": "38fdb168-5074-4b4f-9495-8986af433ea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG os_vif [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38fdb168-50, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67e83864-3839-47a7-b30d-1c08b5edc959) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:08 user nova-compute[74934]: INFO os_vif [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:f9:87,bridge_name='br-int',has_traffic_filtering=True,id=38fdb168-5074-4b4f-9495-8986af433ea9,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38fdb168-50')
Nov 19 15:04:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Deleting instance files /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86_del
Nov 19 15:04:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Deletion of /opt/stack/data/nova/instances/73f74149-9044-4fd3-b73a-5082a7b0fd86_del complete
Nov 19 15:04:08 user nova-compute[74934]: INFO nova.compute.manager [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 19 15:04:08 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:04:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:04:09 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:04:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-43faf7e8-081f-4f4a-ab4a-001b165155bc req-979edfba-a82a-4213-a6b9-44092bebdc35 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-deleted-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:09 user nova-compute[74934]: INFO nova.compute.manager [req-43faf7e8-081f-4f4a-ab4a-001b165155bc req-979edfba-a82a-4213-a6b9-44092bebdc35 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Neutron deleted interface 38fdb168-5074-4b4f-9495-8986af433ea9; detaching it from the instance and deleting it from the info cache
Nov 19 15:04:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-43faf7e8-081f-4f4a-ab4a-001b165155bc req-979edfba-a82a-4213-a6b9-44092bebdc35 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:04:09 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Took 0.67 seconds to deallocate network for instance.
Nov 19 15:04:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-43faf7e8-081f-4f4a-ab4a-001b165155bc req-979edfba-a82a-4213-a6b9-44092bebdc35 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Detach interface failed, port_id=38fdb168-5074-4b4f-9495-8986af433ea9, reason: Instance 73f74149-9044-4fd3-b73a-5082a7b0fd86 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:04:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:09 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:04:09 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-145b1a69-e576-4360-b177-b706362fb6e3 req-84fc6c6b-1180-4e8a-b800-325b08594734 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-145b1a69-e576-4360-b177-b706362fb6e3 req-84fc6c6b-1180-4e8a-b800-325b08594734 service nova] Acquiring lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-145b1a69-e576-4360-b177-b706362fb6e3 req-84fc6c6b-1180-4e8a-b800-325b08594734 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-145b1a69-e576-4360-b177-b706362fb6e3 req-84fc6c6b-1180-4e8a-b800-325b08594734 service nova] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-145b1a69-e576-4360-b177-b706362fb6e3 req-84fc6c6b-1180-4e8a-b800-325b08594734 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] No waiting events found dispatching network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:04:10 user nova-compute[74934]: WARNING nova.compute.manager [req-145b1a69-e576-4360-b177-b706362fb6e3 req-84fc6c6b-1180-4e8a-b800-325b08594734 service nova] [instance: 73f74149-9044-4fd3-b73a-5082a7b0fd86] Received unexpected event network-vif-plugged-38fdb168-5074-4b4f-9495-8986af433ea9 for instance with vm_state deleted and task_state None.
Nov 19 15:04:10 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Deleted allocations for instance 73f74149-9044-4fd3-b73a-5082a7b0fd86
Nov 19 15:04:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ccf049de-2537-476e-974b-284ba70f20f2 tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "73f74149-9044-4fd3-b73a-5082a7b0fd86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.710s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:04:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:04:12 user nova-compute[74934]: INFO nova.compute.claims [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Claim successful on node user
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:04:13 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.policy [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bfce44d2b84477eb863702db114a851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b44750276194728a988349d75795283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:04:13 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Creating image(s)
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "/opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "/opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.224s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk 1073741824" returned: 0 in 0.058s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Successfully created port: 9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.212s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Cannot resize image /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Ensure instance console log exists: /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Successfully updated port: 9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquired lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-changed-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Refreshing instance network info cache due to event network-changed-9cf708dc-610c-4e99-b8c9-6cb458805ecd. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] Acquiring lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:04:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating instance_info_cache with network_info: [{"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Releasing lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Instance network_info: |[{"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] Acquired lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Refreshing network info cache for port 9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Start _get_guest_xml network_info=[{"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:04:15 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:04:15 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-189675044',display_name='tempest-TestServerVolumeAttachmentScenario-server-189675044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-189675044',id=39,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrHUK1pSo4Cesc3EZ+jST/9q6cPWtY0zkSGnFmU94I21BQlESSwbjVQbyQmaWvnAQ4c6aj5GGrd5X3DckV82idM8Qzjo4x2L5fm8rNF5sefNPIbqGqwEK+D55iQOsRyRw==',key_name='tempest-keypair-469899584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b44750276194728a988349d75795283',ramdisk_id='',reservation_id='r-bhjzpag5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1858542823',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1858542823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bfce44d2b84477eb863702db114a851',uuid=acbf8372-5166-49bf-8a1d-a2f0bfb59ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Converting VIF {"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'pci_devices' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:04:15 user nova-compute[74934]:   <uuid>acbf8372-5166-49bf-8a1d-a2f0bfb59ef3</uuid>
Nov 19 15:04:15 user nova-compute[74934]:   <name>instance-00000027</name>
Nov 19 15:04:15 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:04:15 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:04:15 user nova-compute[74934]:   <metadata>
Nov 19 15:04:15 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:04:15 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:04:15 user nova-compute[74934]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-189675044</nova:name>
Nov 19 15:04:15 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:04:15</nova:creationTime>
Nov 19 15:04:15 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:04:15 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:04:15 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:04:15 user nova-compute[74934]:       <nova:owner>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:user uuid="3bfce44d2b84477eb863702db114a851">tempest-TestServerVolumeAttachmentScenario-1858542823-project-member</nova:user>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:project uuid="4b44750276194728a988349d75795283">tempest-TestServerVolumeAttachmentScenario-1858542823</nova:project>
Nov 19 15:04:15 user nova-compute[74934]:       </nova:owner>
Nov 19 15:04:15 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:04:15 user nova-compute[74934]:       <nova:ports>
Nov 19 15:04:15 user nova-compute[74934]:         <nova:port uuid="9cf708dc-610c-4e99-b8c9-6cb458805ecd">
Nov 19 15:04:15 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 19 15:04:15 user nova-compute[74934]:         </nova:port>
Nov 19 15:04:15 user nova-compute[74934]:       </nova:ports>
Nov 19 15:04:15 user nova-compute[74934]:     </nova:instance>
Nov 19 15:04:15 user nova-compute[74934]:   </metadata>
Nov 19 15:04:15 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:04:15 user nova-compute[74934]:     <system>
Nov 19 15:04:15 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:04:15 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:04:15 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:04:15 user nova-compute[74934]:       <entry name="serial">acbf8372-5166-49bf-8a1d-a2f0bfb59ef3</entry>
Nov 19 15:04:15 user nova-compute[74934]:       <entry name="uuid">acbf8372-5166-49bf-8a1d-a2f0bfb59ef3</entry>
Nov 19 15:04:15 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:04:15 user nova-compute[74934]:     </system>
Nov 19 15:04:15 user nova-compute[74934]:   </sysinfo>
Nov 19 15:04:15 user nova-compute[74934]:   <os>
Nov 19 15:04:15 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:04:15 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:04:15 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:04:15 user nova-compute[74934]:   </os>
Nov 19 15:04:15 user nova-compute[74934]:   <features>
Nov 19 15:04:15 user nova-compute[74934]:     <acpi/>
Nov 19 15:04:15 user nova-compute[74934]:     <apic/>
Nov 19 15:04:15 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:04:15 user nova-compute[74934]:   </features>
Nov 19 15:04:15 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:04:15 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:04:15 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:04:15 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:04:15 user nova-compute[74934]:   </clock>
Nov 19 15:04:15 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:04:15 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:04:15 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:04:15 user nova-compute[74934]:   </cpu>
Nov 19 15:04:15 user nova-compute[74934]:   <devices>
Nov 19 15:04:15 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:04:15 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:04:15 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk"/>
Nov 19 15:04:15 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:04:15 user nova-compute[74934]:     </disk>
Nov 19 15:04:15 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:04:15 user nova-compute[74934]:       <mac address="fa:16:3e:40:7c:1a"/>
Nov 19 15:04:15 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:04:15 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:04:15 user nova-compute[74934]:       <target dev="tap9cf708dc-61"/>
Nov 19 15:04:15 user nova-compute[74934]:     </interface>
Nov 19 15:04:15 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:04:15 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/console.log" append="off"/>
Nov 19 15:04:15 user nova-compute[74934]:     </serial>
Nov 19 15:04:15 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:04:15 user nova-compute[74934]:     <video>
Nov 19 15:04:15 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:04:15 user nova-compute[74934]:     </video>
Nov 19 15:04:15 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:04:15 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:04:15 user nova-compute[74934]:     </rng>
Nov 19 15:04:15 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:04:15 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:04:15 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:04:15 user nova-compute[74934]:     </memballoon>
Nov 19 15:04:15 user nova-compute[74934]:   </devices>
Nov 19 15:04:15 user nova-compute[74934]: </domain>
Nov 19 15:04:15 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-189675044',display_name='tempest-TestServerVolumeAttachmentScenario-server-189675044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-189675044',id=39,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrHUK1pSo4Cesc3EZ+jST/9q6cPWtY0zkSGnFmU94I21BQlESSwbjVQbyQmaWvnAQ4c6aj5GGrd5X3DckV82idM8Qzjo4x2L5fm8rNF5sefNPIbqGqwEK+D55iQOsRyRw==',key_name='tempest-keypair-469899584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b44750276194728a988349d75795283',ramdisk_id='',reservation_id='r-bhjzpag5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1858542823',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1858542823-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bfce44d2b84477eb863702db114a851',uuid=acbf8372-5166-49bf-8a1d-a2f0bfb59ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Converting VIF {"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG os_vif [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e23ca3c-b50d-5803-8235-d6bb9fcefc80', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cf708dc-61, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cf708dc-61, col_values=(('qos', UUID('9931acde-8006-4f02-94c3-49d3a27a96cc')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cf708dc-61, col_values=(('external_ids', {'iface-id': '9cf708dc-610c-4e99-b8c9-6cb458805ecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:7c:1a', 'vm-uuid': 'acbf8372-5166-49bf-8a1d-a2f0bfb59ef3'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:15 user nova-compute[74934]: INFO os_vif [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61')
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No VIF found with MAC fa:16:3e:40:7c:1a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updated VIF entry in instance network info cache for port 9cf708dc-610c-4e99-b8c9-6cb458805ecd. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG nova.network.neutron [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating instance_info_cache with network_info: [{"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-05e43967-52ba-4cb2-a9b7-3a234b6faad8 req-b3c89367-fd84-492a-af49-c592693d9adc service nova] Releasing lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:04:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-e78c7031-f582-4923-a5c8-fef90f93c726 req-57186ad5-0e1d-4ddd-9480-2794b111fb5b service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e78c7031-f582-4923-a5c8-fef90f93c726 req-57186ad5-0e1d-4ddd-9480-2794b111fb5b service nova] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e78c7031-f582-4923-a5c8-fef90f93c726 req-57186ad5-0e1d-4ddd-9480-2794b111fb5b service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e78c7031-f582-4923-a5c8-fef90f93c726 req-57186ad5-0e1d-4ddd-9480-2794b111fb5b service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-e78c7031-f582-4923-a5c8-fef90f93c726 req-57186ad5-0e1d-4ddd-9480-2794b111fb5b service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] No waiting events found dispatching network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:04:16 user nova-compute[74934]: WARNING nova.compute.manager [req-e78c7031-f582-4923-a5c8-fef90f93c726 req-57186ad5-0e1d-4ddd-9480-2794b111fb5b service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received unexpected event network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd for instance with vm_state building and task_state spawning.
Nov 19 15:04:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-74bc81e8-edd7-441b-a732-115a57a76459 req-987b16b9-3b6e-4fdc-8e52-f92d3ecbb1bd service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-74bc81e8-edd7-441b-a732-115a57a76459 req-987b16b9-3b6e-4fdc-8e52-f92d3ecbb1bd service nova] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-74bc81e8-edd7-441b-a732-115a57a76459 req-987b16b9-3b6e-4fdc-8e52-f92d3ecbb1bd service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-74bc81e8-edd7-441b-a732-115a57a76459 req-987b16b9-3b6e-4fdc-8e52-f92d3ecbb1bd service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-74bc81e8-edd7-441b-a732-115a57a76459 req-987b16b9-3b6e-4fdc-8e52-f92d3ecbb1bd service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] No waiting events found dispatching network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:04:18 user nova-compute[74934]: WARNING nova.compute.manager [req-74bc81e8-edd7-441b-a732-115a57a76459 req-987b16b9-3b6e-4fdc-8e52-f92d3ecbb1bd service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received unexpected event network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd for instance with vm_state building and task_state spawning.
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:04:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Instance spawned successfully.
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:04:19 user nova-compute[74934]: INFO nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 19 15:04:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:04:19 user nova-compute[74934]: INFO nova.compute.manager [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Took 6.38 seconds to build instance.
Nov 19 15:04:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-3ebafc5f-c07e-4ce3-a5dc-487a2203172d tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.488s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:27 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance edd37f42-f320-4a31-a4a0-2d0441123a61 is timed out.
Nov 19 15:04:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully detached device vdb from instance edd37f42-f320-4a31-a4a0-2d0441123a61 from the live domain config.
Nov 19 15:04:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eMBLrOKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:04:27 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eae2db-95e8-4dae-a409-1882d25c4fbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:04:27 user nova-compute[74934]: No targets found.
Nov 19 15:04:27 user nova-compute[74934]: iSNS:
Nov 19 15:04:27 user nova-compute[74934]: No targets found.
Nov 19 15:04:27 user nova-compute[74934]: STATIC:
Nov 19 15:04:27 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:04:27 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:04:27 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:04:27 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:04:27 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:04:27 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:04:27 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe
Nov 19 15:04:27 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:04:27 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:04:27 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:04:27 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:04:27 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:04:27 user nova-compute[74934]: FIRMWARE:
Nov 19 15:04:27 user nova-compute[74934]: No targets found.
Nov 19 15:04:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:04:27 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:04:27 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68db84d-2ede-47d6-9dc9-eae487b50a09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449c541-183f-4abf-9b46-f5ef4b3a9c09]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:04:27 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:04:27 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:04:27 user nova-compute[74934]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe (non-flash)
Nov 19 15:04:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:04:27 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:04:27 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:04:27 user nova-compute[74934]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe (non-flash)
Nov 19 15:04:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43ff130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe'): ({'sdg'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Removing single pathed devices sdg {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b872767-ee27-41c8-ae8f-1f6a602311c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e9b3f-09fe-40f5-bbe0-f57ca68a3d3d]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Flushing IO for device /dev/sdg {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9d2ae-c12d-4216-b1cd-e977bae26322]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b872c-f8d1-4444-8209-df710513eae1]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] SCSI volumes sdg have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea7f301-09ee-4340-a306-2423f652bebf]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169e5bb-8e1a-4fe5-8e76-83429500beae]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260]
Nov 19 15:04:27 user nova-compute[74934]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe, portal: 172.16.0.220,3260] successful.
Nov 19 15:04:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f403cb43-2163-4e81-b8a4-f19ab35dedbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b772a3-0be9-4777-ab78-57cf43a1c43b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] <== disconnect_volume: return (343ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:04:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:04:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'flavor' on Instance uuid edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:04:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91a05fc9-2dc8-4416-be61-f7d10051fa8c tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 76da41ee-9c9b-4086-863d-7e6d3f3789b4 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid c493f2fb-19fd-4fee-a280-9b0df1a8362c {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 0cfbf310-4580-4054-87dd-613f1e8ad7fa {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid b84f250c-ee76-451f-bf66-68e25842b7e8 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "39aaebaa-b445-4860-87db-34a835082d28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "39aaebaa-b445-4860-87db-34a835082d28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:58 user nova-compute[74934]: INFO nova.compute.manager [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Terminating instance
Nov 19 15:04:58 user nova-compute[74934]: DEBUG nova.compute.manager [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-c93d6016-4745-41e4-88ee-cdb112c6a40c req-b06bf030-6608-4912-b706-9fc5a362da2b service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c93d6016-4745-41e4-88ee-cdb112c6a40c req-b06bf030-6608-4912-b706-9fc5a362da2b service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c93d6016-4745-41e4-88ee-cdb112c6a40c req-b06bf030-6608-4912-b706-9fc5a362da2b service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c93d6016-4745-41e4-88ee-cdb112c6a40c req-b06bf030-6608-4912-b706-9fc5a362da2b service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-c93d6016-4745-41e4-88ee-cdb112c6a40c req-b06bf030-6608-4912-b706-9fc5a362da2b service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:04:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-c93d6016-4745-41e4-88ee-cdb112c6a40c req-b06bf030-6608-4912-b706-9fc5a362da2b service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-unplugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Instance destroyed successfully.
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lazy-loading 'resources' on Instance uuid ede07940-0d9c-41ce-8d54-8b1d042f4da2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:47:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-359330948',display_name='tempest-ServerRescueNegativeTestJSON-server-359330948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-359330948',id=1,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0de5bebd7613411cb782d31ed1884da8',ramdisk_id='',reservation_id='r-3jgjyib6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1330458851',owner_user_name='tempest-ServerRescueNegativeTestJSON-1330458851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:54:43Z,user_data=None,user_id='cdbd678512a7438bac9bc337a0d94ecf',uuid=ede07940-0d9c-41ce-8d54-8b1d042f4da2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converting VIF {"id": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "address": "fa:16:3e:61:d9:8c", "network": {"id": "0ec4a047-0b60-4845-b1de-08235f26f8e6", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1662221806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0de5bebd7613411cb782d31ed1884da8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bfefc92-c8", "ovs_interfaceid": "2bfefc92-c855-4bd2-bf90-d7e3f7847926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG os_vif [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bfefc92-c8, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5bd454d-55d5-4e1d-8120-378929686617) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:04:59 user nova-compute[74934]: INFO os_vif [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:8c,bridge_name='br-int',has_traffic_filtering=True,id=2bfefc92-c855-4bd2-bf90-d7e3f7847926,network=Network(0ec4a047-0b60-4845-b1de-08235f26f8e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bfefc92-c8')
Nov 19 15:04:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Deleting instance files /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2_del
Nov 19 15:04:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Deletion of /opt/stack/data/nova/instances/ede07940-0d9c-41ce-8d54-8b1d042f4da2_del complete
Nov 19 15:04:59 user nova-compute[74934]: INFO nova.compute.manager [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:04:59 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:04:59 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Took 0.51 seconds to deallocate network for instance.
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.524s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:00 user nova-compute[74934]: INFO nova.compute.manager [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] instance snapshotting
Nov 19 15:05:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Beginning live snapshot process
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] Acquiring lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] No waiting events found dispatching network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:05:00 user nova-compute[74934]: WARNING nova.compute.manager [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received unexpected event network-vif-plugged-2bfefc92-c855-4bd2-bf90-d7e3f7847926 for instance with vm_state deleted and task_state None.
Nov 19 15:05:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-b0568412-135c-4945-a61f-aae23622e124 req-0f68271a-d91f-4c3d-af43-eda0511ea20c service nova] [instance: ede07940-0d9c-41ce-8d54-8b1d042f4da2] Received event network-vif-deleted-2bfefc92-c855-4bd2-bf90-d7e3f7847926 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Deleted allocations for instance ede07940-0d9c-41ce-8d54-8b1d042f4da2
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-90e205d9-a98f-41fb-a56c-b468903c732a tempest-ServerRescueNegativeTestJSON-1330458851 tempest-ServerRescueNegativeTestJSON-1330458851-project-member] Lock "ede07940-0d9c-41ce-8d54-8b1d042f4da2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json -f qcow2 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbxyj8bgd/e8d49a0081a9428c975810ad00195ce6.delta 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbxyj8bgd/e8d49a0081a9428c975810ad00195ce6.delta 1073741824" returned: 0 in 0.052s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:05:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:03 user nova-compute[74934]: INFO nova.compute.manager [None req-911d99ac-c5dd-4f32-932e-9c70a234873b tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Get console output
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74934) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 19 15:05:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 19 15:05:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:05:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=24.92153549194336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbxyj8bgd/e8d49a0081a9428c975810ad00195ce6.delta /opt/stack/data/nova/instances/snapshots/tmpbxyj8bgd/e8d49a0081a9428c975810ad00195ce6 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:03 user nova-compute[74934]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 39aaebaa-b445-4860-87db-34a835082d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:05:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:05:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbxyj8bgd/e8d49a0081a9428c975810ad00195ce6.delta /opt/stack/data/nova/instances/snapshots/tmpbxyj8bgd/e8d49a0081a9428c975810ad00195ce6" returned: 0 in 0.696s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:04 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Snapshot extracted, beginning image upload
Nov 19 15:05:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:05:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:05:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:05:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.826s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 76da41ee-9c9b-4086-863d-7e6d3f3789b4 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [{"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-76da41ee-9c9b-4086-863d-7e6d3f3789b4" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:05:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Snapshot image upload complete
Nov 19 15:05:06 user nova-compute[74934]: INFO nova.compute.manager [None req-3a45aec6-e458-4c2d-a65a-4ebb4536b6b3 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Took 5.93 seconds to snapshot the instance on the hypervisor.
Nov 19 15:05:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:07 user nova-compute[74934]: INFO nova.compute.manager [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Terminating instance
Nov 19 15:05:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:05:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c47dab4-4622-4072-b004-0bb96985762d req-f1824afb-7c77-4d30-bbe1-35ee349344ae service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c47dab4-4622-4072-b004-0bb96985762d req-f1824afb-7c77-4d30-bbe1-35ee349344ae service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c47dab4-4622-4072-b004-0bb96985762d req-f1824afb-7c77-4d30-bbe1-35ee349344ae service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2c47dab4-4622-4072-b004-0bb96985762d req-f1824afb-7c77-4d30-bbe1-35ee349344ae service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c47dab4-4622-4072-b004-0bb96985762d req-f1824afb-7c77-4d30-bbe1-35ee349344ae service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-2c47dab4-4622-4072-b004-0bb96985762d req-f1824afb-7c77-4d30-bbe1-35ee349344ae service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-unplugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:05:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Instance destroyed successfully.
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'resources' on Instance uuid 069f95a6-6e49-4054-baf6-7da3d23c0514 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1041188902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1041188902',id=34,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:01:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-5rhaa0c5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:03:22Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=069f95a6-6e49-4054-baf6-7da3d23c0514,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "address": "fa:16:3e:56:07:fd", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92a12e86-cd", "ovs_interfaceid": "92a12e86-cd82-472f-88ea-0d6c6e9556fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_vif [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92a12e86-cd, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32cf7a13-d885-4e25-8ccd-c3c4d647bcfb) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:08 user nova-compute[74934]: INFO os_vif [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:07:fd,bridge_name='br-int',has_traffic_filtering=True,id=92a12e86-cd82-472f-88ea-0d6c6e9556fc,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92a12e86-cd')
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbcsGmAJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:08 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545bb82-1b5b-464d-b4a2-f1a9f7837ffc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:05:08 user nova-compute[74934]: No targets found.
Nov 19 15:05:08 user nova-compute[74934]: iSNS:
Nov 19 15:05:08 user nova-compute[74934]: No targets found.
Nov 19 15:05:08 user nova-compute[74934]: STATIC:
Nov 19 15:05:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833
Nov 19 15:05:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:05:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:05:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:05:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:05:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:05:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:05:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:05:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:05:08 user nova-compute[74934]: FIRMWARE:
Nov 19 15:05:08 user nova-compute[74934]: No targets found.
Nov 19 15:05:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:05:08 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:05:08 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5831e0f4-4c19-46e9-84d9-cfaa45605889]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b80cdc-dc3e-4c70-95ef-a5dcd86f8a48]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:08 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:05:08 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:08 user nova-compute[74934]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 (non-flash)
Nov 19 15:05:08 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c424e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833'): ({'sdf'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Removing single pathed devices sdf {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8298dc-07dc-46b0-9c63-90a5b22cfbeb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2950bce-c16f-49b6-aeac-8e67ce536cb7]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flushing IO for device /dev/sdf {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc7a0c-8b72-4c9e-8de4-c8facc1cba2f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65d421b-5ca0-4e05-abc7-5dc56650d099]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4357d19a-475b151863e170d8', '/dev/disk/by-id/scsi-23437356231353138', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4357d19a') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5517289-097d-4d8c-9609-ef2f7c2804d2]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb18794d-ac3c-4d22-acb5-7e11d34c2901]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3266321-203f-45b9-a0a7-61e8c3449898]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260]
Nov 19 15:05:08 user nova-compute[74934]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833, portal: 172.16.0.220,3260] successful.
Nov 19 15:05:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:123f3d77-d1a9-4963-a249-9e1f6037a833 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acacd2b-846a-4887-90e3-7d4e324caafb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== disconnect_volume: return (334ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:05:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Deleting instance files /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514_del
Nov 19 15:05:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Deletion of /opt/stack/data/nova/instances/069f95a6-6e49-4054-baf6-7da3d23c0514_del complete
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:05:08 user nova-compute[74934]: INFO nova.compute.claims [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Claim successful on node user
Nov 19 15:05:08 user nova-compute[74934]: INFO nova.compute.manager [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 19 15:05:08 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:05:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:05:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.policy [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '626bafbaac4f4454a21f429798b56194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f136401348054bdaa49dc9a1f71a27b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:05:09 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Creating image(s)
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "/opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "/opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "/opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "9e23a6a8b3a3facf236435b532ca84df1a1be7ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "9e23a6a8b3a3facf236435b532ca84df1a1be7ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.part --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-4d38f215-aea5-49ea-8a89-510e81d87300 req-f14499a1-5664-4705-805d-c50deb48616c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-deleted-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:10 user nova-compute[74934]: INFO nova.compute.manager [req-4d38f215-aea5-49ea-8a89-510e81d87300 req-f14499a1-5664-4705-805d-c50deb48616c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Neutron deleted interface 92a12e86-cd82-472f-88ea-0d6c6e9556fc; detaching it from the instance and deleting it from the info cache
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-4d38f215-aea5-49ea-8a89-510e81d87300 req-f14499a1-5664-4705-805d-c50deb48616c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e15677d-f347-4bdb-b145-373310e52a4e req-406bdaa0-5d6c-4802-a459-b0d29c29c953 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e15677d-f347-4bdb-b145-373310e52a4e req-406bdaa0-5d6c-4802-a459-b0d29c29c953 service nova] Acquiring lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e15677d-f347-4bdb-b145-373310e52a4e req-406bdaa0-5d6c-4802-a459-b0d29c29c953 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e15677d-f347-4bdb-b145-373310e52a4e req-406bdaa0-5d6c-4802-a459-b0d29c29c953 service nova] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e15677d-f347-4bdb-b145-373310e52a4e req-406bdaa0-5d6c-4802-a459-b0d29c29c953 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] No waiting events found dispatching network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:05:10 user nova-compute[74934]: WARNING nova.compute.manager [req-2e15677d-f347-4bdb-b145-373310e52a4e req-406bdaa0-5d6c-4802-a459-b0d29c29c953 service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Received unexpected event network-vif-plugged-92a12e86-cd82-472f-88ea-0d6c6e9556fc for instance with vm_state active and task_state deleting.
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-4d38f215-aea5-49ea-8a89-510e81d87300 req-f14499a1-5664-4705-805d-c50deb48616c service nova] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Detach interface failed, port_id=92a12e86-cd82-472f-88ea-0d6c6e9556fc, reason: Instance 069f95a6-6e49-4054-baf6-7da3d23c0514 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:05:10 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Took 1.67 seconds to deallocate network for instance.
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.virt.images [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] e80ef986-086b-4d99-888a-8cdec229309b was qcow2, converting to raw {{(pid=74934) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG nova.privsep.utils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74934) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 19 15:05:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.part /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.converted {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Successfully created port: 285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.part /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.converted" returned: 0 in 0.833s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.converted --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:11 user nova-compute[74934]: INFO nova.compute.manager [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 069f95a6-6e49-4054-baf6-7da3d23c0514] Took 1.00 seconds to detach 1 volumes for instance.
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "9e23a6a8b3a3facf236435b532ca84df1a1be7ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.166s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca --force-share --output=json" returned: 0 in 0.200s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "9e23a6a8b3a3facf236435b532ca84df1a1be7ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "9e23a6a8b3a3facf236435b532ca84df1a1be7ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Successfully updated port: 285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca --force-share --output=json" returned: 0 in 0.209s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca,backing_fmt=raw /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquired lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-changed-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Refreshing instance network info cache due to event network-changed-285f4f66-d166-45a0-b144-2c7764235d78. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] Acquiring lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca,backing_fmt=raw /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk 1073741824" returned: 0 in 0.080s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "9e23a6a8b3a3facf236435b532ca84df1a1be7ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:12 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Deleted allocations for instance 069f95a6-6e49-4054-baf6-7da3d23c0514
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-33435007-2aa7-42a5-a614-7f4d1b62641e tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "069f95a6-6e49-4054-baf6-7da3d23c0514" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.709s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Ensure instance console log exists: /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updating instance_info_cache with network_info: [{"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Releasing lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Instance network_info: |[{"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] Acquired lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Refreshing network info cache for port 285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Start _get_guest_xml network_info=[{"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='231ff5e81c84b7ed62850874101e900b',container_format='bare',created_at=2023-11-19T15:05:00Z,direct_url=<?>,disk_format='qcow2',id=e80ef986-086b-4d99-888a-8cdec229309b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-999003700',owner='f136401348054bdaa49dc9a1f71a27b8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-19T15:05:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': 'e80ef986-086b-4d99-888a-8cdec229309b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:05:12 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:05:12 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='231ff5e81c84b7ed62850874101e900b',container_format='bare',created_at=2023-11-19T15:05:00Z,direct_url=<?>,disk_format='qcow2',id=e80ef986-086b-4d99-888a-8cdec229309b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-999003700',owner='f136401348054bdaa49dc9a1f71a27b8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-19T15:05:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1020007602',display_name='tempest-TestStampPattern-server-1020007602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1020007602',id=40,image_ref='e80ef986-086b-4d99-888a-8cdec229309b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaznw+RT83MzYqjptBb1X4uW71wuVbCdmq+x1BcxoN6wge7Gyi94Xn4EaUTF1JIME5dMfgYbCZc4W6KVhbk5bf817if+fSPUvesBQahayNGBEygMuHSuo8LZiRqixE7vA==',key_name='tempest-TestStampPattern-449749249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f136401348054bdaa49dc9a1f71a27b8',ramdisk_id='',reservation_id='r-yit1xxqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='edd37f42-f320-4a31-a4a0-2d0441123a61',image_min_disk='1',image_min_ram='0',image_owner_id='f136401348054bdaa49dc9a1f71a27b8',image_owner_project_name='tempest-TestStampPattern-310548474',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-310548474-project-member',image_user_id='626bafbaac4f4454a21f429798b56194',network_allocated='True',owner_project_name='tempest-TestStampPattern-310548474',owner_user_name='tempest-TestStampPattern-310548474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:05:09Z,user_data=None,user_id='626bafbaac4f4454a21f429798b56194',uuid=f22d32e5-e4b4-497e-bba7-affbd725831f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converting VIF {"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.objects.instance [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'pci_devices' on Instance uuid f22d32e5-e4b4-497e-bba7-affbd725831f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:05:12 user nova-compute[74934]:   <uuid>f22d32e5-e4b4-497e-bba7-affbd725831f</uuid>
Nov 19 15:05:12 user nova-compute[74934]:   <name>instance-00000028</name>
Nov 19 15:05:12 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:05:12 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:05:12 user nova-compute[74934]:   <metadata>
Nov 19 15:05:12 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:05:12 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:05:12 user nova-compute[74934]:       <nova:name>tempest-TestStampPattern-server-1020007602</nova:name>
Nov 19 15:05:12 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:05:12</nova:creationTime>
Nov 19 15:05:12 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:05:12 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:05:12 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:05:12 user nova-compute[74934]:       <nova:owner>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:user uuid="626bafbaac4f4454a21f429798b56194">tempest-TestStampPattern-310548474-project-member</nova:user>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:project uuid="f136401348054bdaa49dc9a1f71a27b8">tempest-TestStampPattern-310548474</nova:project>
Nov 19 15:05:12 user nova-compute[74934]:       </nova:owner>
Nov 19 15:05:12 user nova-compute[74934]:       <nova:root type="image" uuid="e80ef986-086b-4d99-888a-8cdec229309b"/>
Nov 19 15:05:12 user nova-compute[74934]:       <nova:ports>
Nov 19 15:05:12 user nova-compute[74934]:         <nova:port uuid="285f4f66-d166-45a0-b144-2c7764235d78">
Nov 19 15:05:12 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 15:05:12 user nova-compute[74934]:         </nova:port>
Nov 19 15:05:12 user nova-compute[74934]:       </nova:ports>
Nov 19 15:05:12 user nova-compute[74934]:     </nova:instance>
Nov 19 15:05:12 user nova-compute[74934]:   </metadata>
Nov 19 15:05:12 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:05:12 user nova-compute[74934]:     <system>
Nov 19 15:05:12 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:05:12 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:05:12 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:05:12 user nova-compute[74934]:       <entry name="serial">f22d32e5-e4b4-497e-bba7-affbd725831f</entry>
Nov 19 15:05:12 user nova-compute[74934]:       <entry name="uuid">f22d32e5-e4b4-497e-bba7-affbd725831f</entry>
Nov 19 15:05:12 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:05:12 user nova-compute[74934]:     </system>
Nov 19 15:05:12 user nova-compute[74934]:   </sysinfo>
Nov 19 15:05:12 user nova-compute[74934]:   <os>
Nov 19 15:05:12 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:05:12 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:05:12 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:05:12 user nova-compute[74934]:   </os>
Nov 19 15:05:12 user nova-compute[74934]:   <features>
Nov 19 15:05:12 user nova-compute[74934]:     <acpi/>
Nov 19 15:05:12 user nova-compute[74934]:     <apic/>
Nov 19 15:05:12 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:05:12 user nova-compute[74934]:   </features>
Nov 19 15:05:12 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:05:12 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:05:12 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:05:12 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:05:12 user nova-compute[74934]:   </clock>
Nov 19 15:05:12 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:05:12 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:05:12 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:05:12 user nova-compute[74934]:   </cpu>
Nov 19 15:05:12 user nova-compute[74934]:   <devices>
Nov 19 15:05:12 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:05:12 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:05:12 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk"/>
Nov 19 15:05:12 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:05:12 user nova-compute[74934]:     </disk>
Nov 19 15:05:12 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:05:12 user nova-compute[74934]:       <mac address="fa:16:3e:b5:3d:eb"/>
Nov 19 15:05:12 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:05:12 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:05:12 user nova-compute[74934]:       <target dev="tap285f4f66-d1"/>
Nov 19 15:05:12 user nova-compute[74934]:     </interface>
Nov 19 15:05:12 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:05:12 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/console.log" append="off"/>
Nov 19 15:05:12 user nova-compute[74934]:     </serial>
Nov 19 15:05:12 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:05:12 user nova-compute[74934]:     <video>
Nov 19 15:05:12 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:05:12 user nova-compute[74934]:     </video>
Nov 19 15:05:12 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:05:12 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:05:12 user nova-compute[74934]:     </rng>
Nov 19 15:05:12 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:05:12 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:05:12 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:05:12 user nova-compute[74934]:     </memballoon>
Nov 19 15:05:12 user nova-compute[74934]:   </devices>
Nov 19 15:05:12 user nova-compute[74934]: </domain>
Nov 19 15:05:12 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1020007602',display_name='tempest-TestStampPattern-server-1020007602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1020007602',id=40,image_ref='e80ef986-086b-4d99-888a-8cdec229309b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaznw+RT83MzYqjptBb1X4uW71wuVbCdmq+x1BcxoN6wge7Gyi94Xn4EaUTF1JIME5dMfgYbCZc4W6KVhbk5bf817if+fSPUvesBQahayNGBEygMuHSuo8LZiRqixE7vA==',key_name='tempest-TestStampPattern-449749249',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f136401348054bdaa49dc9a1f71a27b8',ramdisk_id='',reservation_id='r-yit1xxqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='edd37f42-f320-4a31-a4a0-2d0441123a61',image_min_disk='1',image_min_ram='0',image_owner_id='f136401348054bdaa49dc9a1f71a27b8',image_owner_project_name='tempest-TestStampPattern-310548474',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-310548474-project-member',image_user_id='626bafbaac4f4454a21f429798b56194',network_allocated='True',owner_project_name='tempest-TestStampPattern-310548474',owner_user_name='tempest-TestStampPattern-310548474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:05:09Z,user_data=None,user_id='626bafbaac4f4454a21f429798b56194',uuid=f22d32e5-e4b4-497e-bba7-affbd725831f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converting VIF {"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG os_vif [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8883ce0a-e5c3-590f-8b6e-20373b28851e', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap285f4f66-d1, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap285f4f66-d1, col_values=(('qos', UUID('0d840065-306f-451f-8e1d-e8cb5a18e2e9')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap285f4f66-d1, col_values=(('external_ids', {'iface-id': '285f4f66-d166-45a0-b144-2c7764235d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:3d:eb', 'vm-uuid': 'f22d32e5-e4b4-497e-bba7-affbd725831f'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:12 user nova-compute[74934]: INFO os_vif [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1')
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No VIF found with MAC fa:16:3e:b5:3d:eb, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:05:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updated VIF entry in instance network info cache for port 285f4f66-d166-45a0-b144-2c7764235d78. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:05:13 user nova-compute[74934]: DEBUG nova.network.neutron [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updating instance_info_cache with network_info: [{"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0b9f34c3-8e06-4b7b-adcb-71169ccd6f29 req-b86bf290-6a01-43cf-8ee3-a3e9cd3b4057 service nova] Releasing lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-d9b96081-1282-4b65-afa6-7e6677d6aace req-232dc14e-e793-4d2f-8125-eab99efdd8b9 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9b96081-1282-4b65-afa6-7e6677d6aace req-232dc14e-e793-4d2f-8125-eab99efdd8b9 service nova] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9b96081-1282-4b65-afa6-7e6677d6aace req-232dc14e-e793-4d2f-8125-eab99efdd8b9 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9b96081-1282-4b65-afa6-7e6677d6aace req-232dc14e-e793-4d2f-8125-eab99efdd8b9 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-d9b96081-1282-4b65-afa6-7e6677d6aace req-232dc14e-e793-4d2f-8125-eab99efdd8b9 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] No waiting events found dispatching network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:05:14 user nova-compute[74934]: WARNING nova.compute.manager [req-d9b96081-1282-4b65-afa6-7e6677d6aace req-232dc14e-e793-4d2f-8125-eab99efdd8b9 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received unexpected event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 for instance with vm_state building and task_state spawning.
Nov 19 15:05:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-4f54e955-b380-47d3-8e0b-3a762c586a4e req-ed66b315-3c75-48be-bb04-c57fefa94014 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f54e955-b380-47d3-8e0b-3a762c586a4e req-ed66b315-3c75-48be-bb04-c57fefa94014 service nova] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f54e955-b380-47d3-8e0b-3a762c586a4e req-ed66b315-3c75-48be-bb04-c57fefa94014 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4f54e955-b380-47d3-8e0b-3a762c586a4e req-ed66b315-3c75-48be-bb04-c57fefa94014 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-4f54e955-b380-47d3-8e0b-3a762c586a4e req-ed66b315-3c75-48be-bb04-c57fefa94014 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] No waiting events found dispatching network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:05:16 user nova-compute[74934]: WARNING nova.compute.manager [req-4f54e955-b380-47d3-8e0b-3a762c586a4e req-ed66b315-3c75-48be-bb04-c57fefa94014 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received unexpected event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 for instance with vm_state building and task_state spawning.
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:05:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Instance spawned successfully.
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:05:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:05:17 user nova-compute[74934]: INFO nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Took 7.48 seconds to spawn the instance on the hypervisor.
Nov 19 15:05:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:05:17 user nova-compute[74934]: INFO nova.compute.manager [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Took 8.31 seconds to build instance.
Nov 19 15:05:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-80dd7051-51f5-4dae-9a1e-2fdc07f017b2 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.409s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:05:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-changed-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Refreshing instance network info cache due to event network-changed-80b59d4a-d7d6-4adb-8124-083498d14e16. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] Acquiring lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] Acquired lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.network.neutron [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Refreshing network info cache for port 80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.network.neutron [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updated VIF entry in instance network info cache for port 80b59d4a-d7d6-4adb-8124-083498d14e16. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.network.neutron [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updating instance_info_cache with network_info: [{"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-fae3eb08-071d-45b9-99d6-fd2612e26daf req-efc83e2e-d074-43bd-a6fe-86da7589f7b5 service nova] Releasing lock "refresh_cache-39aaebaa-b445-4860-87db-34a835082d28" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-changed-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Refreshing instance network info cache due to event network-changed-8ad1b074-aba2-4905-943d-5694480f9631. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] Acquiring lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] Acquired lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:05:35 user nova-compute[74934]: DEBUG nova.network.neutron [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Refreshing network info cache for port 8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:05:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updated VIF entry in instance network info cache for port 8ad1b074-aba2-4905-943d-5694480f9631. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:05:36 user nova-compute[74934]: DEBUG nova.network.neutron [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updating instance_info_cache with network_info: [{"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-27d855b0-f619-4081-b7c4-30ac31f667f1 req-425cff3b-aafa-4d95-9db2-1a6b738fc101 service nova] Releasing lock "refresh_cache-920e8234-66a1-43a8-bc6a-b3a4d31341c2" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:37 user nova-compute[74934]: INFO nova.compute.manager [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attaching volume 0299c0f1-3f1d-48a9-914e-ecbf06e2057b to /dev/vdb
Nov 19 15:05:37 user nova-compute[74934]: DEBUG os_brick.utils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6707b66-a04f-4039-9ae7-f770df299155]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad6220d-ee92-473a-9fcd-d14df93202d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55d7b8-3071-4245-9bcf-a4a05125b8c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[febabbb8-751b-4e22-bae6-55c550f943cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:05:37 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f03cc1-a4ba-4fd0-8de6-0810573f03f9]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG os_brick.utils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updating existing volume attachment record: 8ea3bcb4-c1a8-4e93-b24f-cd4403540dea {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:05:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:38 user nova-compute[74934]: INFO nova.compute.manager [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Attaching volume 99057d1a-414b-4cb2-942a-812cda903879 to /dev/vdb
Nov 19 15:05:38 user nova-compute[74934]: DEBUG os_brick.utils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e07f60-1328-46eb-8788-eca3b4d8b1fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e5cd2a-a6d1-4037-b8a8-b9bb35a43b97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[39723759-9645-4894-a4ba-9f113ff263cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[338151f3-9bba-4414-81b4-d737fae6d0c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:05:38 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:05:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cfcad8-3f07-4e3e-b113-a4223ceb9717]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG os_brick.utils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:38 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updating existing volume attachment record: 3dbb4813-cbc1-4848-8833-dc9268e279ad {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:05:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFiSmZIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:43 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:43 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:43 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53efda-cbc6-40e7-96d3-837eed7d09cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:05:43 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[21178c9f-ae3b-4d11-b4b2-430b575a35a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b] added
Nov 19 15:05:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6659c264-bafa-4f6b-85ed-6013e70eee94]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11fad9-54c2-4583-807c-3ce7221fb030]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFiSmZIg {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFiSmZIg" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b18f3-62e0-4366-9a4e-7beaeb91b37d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFiSmZIg'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b45fdd2-1d22-4bae-b266-e0570c7b17f5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f1e52-7ecb-4ce4-94c0-804a7dd7718d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:43 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:43 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[58181275-2664-4c66-a438-65c0ddaee3d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260]
Nov 19 15:05:43 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260] successful.
Nov 19 15:05:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McdNjQfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:43 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[81812bc5-c37a-4b8c-a908-b030a5163703]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d8f65b-f081-4ba7-a8c6-4b0868fd7a2b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:43 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:43 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:43 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:43 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c191ad25-a300-4bd1-9443-1aafd5ffe9cd]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFiSmZIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23963366361313164', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963366361313164', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.062s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:44 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:44 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[068bdfef-a207-462c-89a2-415d279528a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:05:44 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:05:44 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:44 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:05:44 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:05:44 user nova-compute[74934]:   <serial>0299c0f1-3f1d-48a9-914e-ecbf06e2057b</serial>
Nov 19 15:05:44 user nova-compute[74934]: </disk>
Nov 19 15:05:44 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad078d4-09b6-446d-accf-42fc030950d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879] added
Nov 19 15:05:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a2c128-46e5-43e1-bb79-ce6230d0f888]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f12a7a-1e07-4bf7-89b7-26cea3f6c92d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McdNjQfu {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McdNjQfu" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9932bc66-53d3-45c8-9e07-2cbbeb463015]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'McdNjQfu'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1a89b-ba1d-472a-9a48-232e732ad8a5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[46639e61-88c1-4f38-8ec9-461be724904c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:44 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:44 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:44 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:44 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[344e216a-ebd0-42d8-bab0-dc6ddfb73451]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260]
Nov 19 15:05:45 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260] successful.
Nov 19 15:05:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aff4ee-e1e8-43e1-8a22-dbdb59e14977]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f9fb4f-5caa-4a4f-a450-a956de6c7c5d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:45 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:45 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:45 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:05:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:45 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:45 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:45 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:05:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2019be0-27e9-43e2-87ea-a04f30209202]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McdNjQfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No VIF found with MAC fa:16:3e:3d:a0:7f, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4dd8946f-6d87-4ca2-bfb3-b6f511cc0c2b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.655s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== connect_volume: return (2367ms) {'type': 'block', 'scsi_wwn': '26266613430653133', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266613430653133', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:05:46 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:46 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:05:46 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:05:46 user nova-compute[74934]:   <serial>99057d1a-414b-4cb2-942a-812cda903879</serial>
Nov 19 15:05:46 user nova-compute[74934]: </disk>
Nov 19 15:05:46 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] No VIF found with MAC fa:16:3e:39:00:18, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:05:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eb266463-2bde-4ca6-bd77-6f6d00b24f38 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.584s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:48 user nova-compute[74934]: INFO nova.compute.manager [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Detaching volume 99057d1a-414b-4cb2-942a-812cda903879
Nov 19 15:05:48 user nova-compute[74934]: INFO nova.virt.block_device [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Attempting to driver detach volume 99057d1a-414b-4cb2-942a-812cda903879 from mountpoint /dev/vdb
Nov 19 15:05:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Attempting to detach device vdb from instance 39aaebaa-b445-4860-87db-34a835082d28 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:05:48 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:48 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:05:48 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:05:48 user nova-compute[74934]:   <serial>99057d1a-414b-4cb2-942a-812cda903879</serial>
Nov 19 15:05:48 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:05:48 user nova-compute[74934]: </disk>
Nov 19 15:05:48 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:05:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully detached device vdb from instance 39aaebaa-b445-4860-87db-34a835082d28 from the persistent domain config.
Nov 19 15:05:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39aaebaa-b445-4860-87db-34a835082d28 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:05:48 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:48 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:05:48 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:05:48 user nova-compute[74934]:   <serial>99057d1a-414b-4cb2-942a-812cda903879</serial>
Nov 19 15:05:48 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:05:48 user nova-compute[74934]: </disk>
Nov 19 15:05:48 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:49 user nova-compute[74934]: INFO nova.compute.manager [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attaching volume 653d7ea3-52fe-417f-85d9-99b4dcecf0ac to /dev/vdc
Nov 19 15:05:49 user nova-compute[74934]: DEBUG os_brick.utils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[04747fb3-bdea-42ce-beff-99aef5c31123]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ceabb4-4d40-430c-b1bf-302f092e55b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07285f-e3fc-4519-b290-24d493afaba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e178e5f1-e0e5-43f7-a382-a385d00d5ce1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:05:49 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:05:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8304ab-611f-4fde-af2c-d2ceef1d184e]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG os_brick.utils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updating existing volume attachment record: 6391c44c-9205-4f5f-b14d-d62224eeecdc {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:05:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoVFhHQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:05:55 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:55 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:05:55 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbb1a91-92d2-4b42-8987-ac58d05b24f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:05:55 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3e83a-11ac-406c-b84f-53945baa0960]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac] added
Nov 19 15:05:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e5fe3f-6f08-42b8-83f0-f40bda1cfbb0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[81856c24-1a5b-44be-a7b1-f86902ea5887]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoVFhHQz {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoVFhHQz" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[352c0117-6331-4d9e-9ad0-600bb1d93d72]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoVFhHQz'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f4b597-8435-481b-bb84-4591520a013a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[917329c2-e76e-47f4-b4c7-ff74bc9989d2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b30d70-36ef-4f8a-b3e9-504bd5247705]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260]
Nov 19 15:05:55 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260] successful.
Nov 19 15:05:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[be531be0-01a5-44da-a0de-c133358237e2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d31d9f-1abb-47c6-acca-177a44591c28]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:05:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:05:55 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:05:55 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[960cd11d-6431-4617-9e1a-bc200904e4c2]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:05:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoVFhHQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26631396231643231', 'path': '/dev/sdf'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631396231643231', 'path': '/dev/sdf'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.objects.instance [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:05:56 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:56 user nova-compute[74934]:   <source dev="/dev/sdf"/>
Nov 19 15:05:56 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 15:05:56 user nova-compute[74934]:   <serial>653d7ea3-52fe-417f-85d9-99b4dcecf0ac</serial>
Nov 19 15:05:56 user nova-compute[74934]: </disk>
Nov 19 15:05:56 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] No VIF found with MAC fa:16:3e:3d:a0:7f, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:05:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-859680e3-d0c5-4ab4-9ae3-f27a6071466b tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.867s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:05:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:58 user nova-compute[74934]: INFO nova.compute.manager [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Detaching volume 0299c0f1-3f1d-48a9-914e-ecbf06e2057b
Nov 19 15:05:58 user nova-compute[74934]: INFO nova.virt.block_device [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attempting to driver detach volume 0299c0f1-3f1d-48a9-914e-ecbf06e2057b from mountpoint /dev/vdb
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Attempting to detach device vdb from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:05:58 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:58 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:05:58 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:05:58 user nova-compute[74934]:   <serial>0299c0f1-3f1d-48a9-914e-ecbf06e2057b</serial>
Nov 19 15:05:58 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:05:58 user nova-compute[74934]: </disk>
Nov 19 15:05:58 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:05:58 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully detached device vdb from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the persistent domain config.
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:05:58 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:05:58 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:05:58 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:05:58 user nova-compute[74934]:   <serial>0299c0f1-3f1d-48a9-914e-ecbf06e2057b</serial>
Nov 19 15:05:58 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:05:58 user nova-compute[74934]: </disk>
Nov 19 15:05:58 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:58 user nova-compute[74934]: INFO nova.compute.manager [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Terminating instance
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.compute.manager [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-3881938a-138e-481e-99cf-2832748ca34c req-92684041-eb43-4fb6-ad45-8bf79795d340 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-vif-unplugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3881938a-138e-481e-99cf-2832748ca34c req-92684041-eb43-4fb6-ad45-8bf79795d340 service nova] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3881938a-138e-481e-99cf-2832748ca34c req-92684041-eb43-4fb6-ad45-8bf79795d340 service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3881938a-138e-481e-99cf-2832748ca34c req-92684041-eb43-4fb6-ad45-8bf79795d340 service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-3881938a-138e-481e-99cf-2832748ca34c req-92684041-eb43-4fb6-ad45-8bf79795d340 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] No waiting events found dispatching network-vif-unplugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-3881938a-138e-481e-99cf-2832748ca34c req-92684041-eb43-4fb6-ad45-8bf79795d340 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-vif-unplugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Instance destroyed successfully.
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'resources' on Instance uuid 0cfbf310-4580-4054-87dd-613f1e8ad7fa {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-667716880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-667716880',id=30,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-aocamzbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:58:32Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=0cfbf310-4580-4054-87dd-613f1e8ad7fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "address": "fa:16:3e:a3:3a:79", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d364ed-e6", "ovs_interfaceid": "92d364ed-e618-47c7-a0b9-1121c50bd8f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG os_vif [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92d364ed-e6, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd172be5-a348-4b58-88a5-fdae813cbc7b) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:05:59 user nova-compute[74934]: INFO os_vif [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:3a:79,bridge_name='br-int',has_traffic_filtering=True,id=92d364ed-e618-47c7-a0b9-1121c50bd8f8,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d364ed-e6')
Nov 19 15:05:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Deleting instance files /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa_del
Nov 19 15:05:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Deletion of /opt/stack/data/nova/instances/0cfbf310-4580-4054-87dd-613f1e8ad7fa_del complete
Nov 19 15:05:59 user nova-compute[74934]: INFO nova.compute.manager [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 19 15:05:59 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:05:59 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Took 0.56 seconds to deallocate network for instance.
Nov 19 15:05:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-409a2f97-20df-4a7d-8678-337e18f1eda5 req-f859d692-bdb1-42b4-aa4d-f61ab595ab8a service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-vif-deleted-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:05:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:00 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Deleted allocations for instance 0cfbf310-4580-4054-87dd-613f1e8ad7fa
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-902097bd-c21a-43f4-86a4-d69cfbe349c5 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-60427070-5dc5-4990-a777-f93199bf390c req-54b96f4f-21ab-412b-91dd-1bf0d0cda3f6 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received event network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-60427070-5dc5-4990-a777-f93199bf390c req-54b96f4f-21ab-412b-91dd-1bf0d0cda3f6 service nova] Acquiring lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-60427070-5dc5-4990-a777-f93199bf390c req-54b96f4f-21ab-412b-91dd-1bf0d0cda3f6 service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-60427070-5dc5-4990-a777-f93199bf390c req-54b96f4f-21ab-412b-91dd-1bf0d0cda3f6 service nova] Lock "0cfbf310-4580-4054-87dd-613f1e8ad7fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-60427070-5dc5-4990-a777-f93199bf390c req-54b96f4f-21ab-412b-91dd-1bf0d0cda3f6 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] No waiting events found dispatching network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:00 user nova-compute[74934]: WARNING nova.compute.manager [req-60427070-5dc5-4990-a777-f93199bf390c req-54b96f4f-21ab-412b-91dd-1bf0d0cda3f6 service nova] [instance: 0cfbf310-4580-4054-87dd-613f1e8ad7fa] Received unexpected event network-vif-plugged-92d364ed-e618-47c7-a0b9-1121c50bd8f8 for instance with vm_state deleted and task_state None.
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:06:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-changed-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Refreshing instance network info cache due to event network-changed-9cf708dc-610c-4e99-b8c9-6cb458805ecd. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] Acquiring lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] Acquired lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.network.neutron [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Refreshing network info cache for port 9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:06:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:06:03 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=7875MB free_disk=24.87457275390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f1546e24-c8ba-40b9-81f9-084ab10c9a31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance b84f250c-ee76-451f-bf66-68e25842b7e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 39aaebaa-b445-4860-87db-34a835082d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f22d32e5-e4b4-497e-bba7-affbd725831f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:06:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.network.neutron [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updated VIF entry in instance network info cache for port 9cf708dc-610c-4e99-b8c9-6cb458805ecd. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.network.neutron [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating instance_info_cache with network_info: [{"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f471c037-36d9-4b2f-a6c8-22d0af99d944 req-babaefbb-95bd-403b-b2d2-ca13abd69b3e service nova] Releasing lock "refresh_cache-acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:04 user nova-compute[74934]: INFO nova.compute.manager [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Terminating instance
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.compute.manager [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.objects.instance [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'flavor' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:04 user nova-compute[74934]: INFO nova.compute.manager [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attaching volume eb3bf03e-a022-4852-9201-672d3b5b20f2 to /dev/vdb
Nov 19 15:06:04 user nova-compute[74934]: DEBUG os_brick.utils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19586ac-035a-4f5a-a56d-9611c9056f75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a937ea40-b642-43cf-ad9a-30f9665f4be7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0872dbb1-5496-450b-bdd7-deedc36265e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1892a-96a8-4660-a839-9756c5da45d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:06:04 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:06:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6fa51-e427-43a3-9e42-02c29d7bd25b]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG os_brick.utils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:04 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating existing volume attachment record: 922fb415-3d82-4e83-a09b-b54b77c511c6 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:06:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Instance destroyed successfully.
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.objects.instance [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'resources' on Instance uuid b84f250c-ee76-451f-bf66-68e25842b7e8 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696276764',display_name='tempest-ServerActionsTestOtherA-server-696276764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-696276764',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-lnfmhdyt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=b84f250c-ee76-451f-bf66-68e25842b7e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "address": "fa:16:3e:46:c6:b9", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e3cf8bc-d4", "ovs_interfaceid": "9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_vif [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e3cf8bc-d4, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f823fd68-041d-420b-8cfa-dab229646332) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:05 user nova-compute[74934]: INFO os_vif [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:c6:b9,bridge_name='br-int',has_traffic_filtering=True,id=9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e3cf8bc-d4')
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWzhEYqR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:05 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ed4c58-79f8-4c81-9d9c-6be0547ebf78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:06:05 user nova-compute[74934]: No targets found.
Nov 19 15:06:05 user nova-compute[74934]: iSNS:
Nov 19 15:06:05 user nova-compute[74934]: No targets found.
Nov 19 15:06:05 user nova-compute[74934]: STATIC:
Nov 19 15:06:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b
Nov 19 15:06:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac
Nov 19 15:06:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:06:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3
Nov 19 15:06:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:05 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879
Nov 19 15:06:05 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:05 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:05 user nova-compute[74934]: FIRMWARE:
Nov 19 15:06:05 user nova-compute[74934]: No targets found.
Nov 19 15:06:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:06:05 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:06:05 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd14f1c-84fb-456b-9ddb-287735fe3a47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d45f61-ab6a-4535-a71b-6cf6e3c4aced]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:06:05 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e41c7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3'): ({'sde'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Removing single pathed devices sde {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638820d-9ab2-4a45-9202-97d03276d543]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5264ece3-ee66-457c-b6bd-fec9185887c3]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Flushing IO for device /dev/sde {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[68110173-424e-4b7c-9118-47b919e7e802]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af6657f-a567-49d5-9263-52e65c4ef44a]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] SCSI volumes sde have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26239373439343239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8f25e5a4', '/dev/disk/by-id/scsi-1SCST_BIO8f25e5a4-b974942969e408c2') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ee0af-6de1-47b8-a4ec-009f3aba109e]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0141035-ebf8-41f5-bb94-41e8262ba625]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7be844-d48c-4073-9584-5c0053534a9e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260]
Nov 19 15:06:05 user nova-compute[74934]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bf72fa-eafa-46f5-b4f3-37a469530bf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[54eda6f6-cd3c-4a2d-aa37-520709993c98]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] <== disconnect_volume: return (350ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:06:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Deleting instance files /opt/stack/data/nova/instances/b84f250c-ee76-451f-bf66-68e25842b7e8_del
Nov 19 15:06:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Deletion of /opt/stack/data/nova/instances/b84f250c-ee76-451f-bf66-68e25842b7e8_del complete
Nov 19 15:06:05 user nova-compute[74934]: INFO nova.compute.manager [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-unplugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] Acquiring lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] No waiting events found dispatching network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:05 user nova-compute[74934]: WARNING nova.compute.manager [req-2e8bb2da-3624-458f-9e04-0a0046f1b71d req-40c3adda-0ad3-4eb0-8b17-e9a5c5c48106 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received unexpected event network-vif-plugged-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe for instance with vm_state active and task_state deleting.
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [{"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-c493f2fb-19fd-4fee-a280-9b0df1a8362c" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:06:06 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:06 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Took 0.87 seconds to deallocate network for instance.
Nov 19 15:06:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-9cfd1c17-afc5-4b02-bfaf-c89d7b9aa34a req-3569eefe-a5ee-4e91-9200-3ece5746da21 service nova] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Received event network-vif-deleted-9e3cf8bc-d47a-43e8-9296-7fc60dcc25fe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:07 user nova-compute[74934]: INFO nova.compute.manager [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Took 0.82 seconds to detach 1 volumes for instance.
Nov 19 15:06:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: b84f250c-ee76-451f-bf66-68e25842b7e8] Deleting volume: 57bf72fa-eafa-46f5-b4f3-37a469530bf3 {{(pid=74934) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 19 15:06:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:07 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:07 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:07 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Deleted allocations for instance b84f250c-ee76-451f-bf66-68e25842b7e8
Nov 19 15:06:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-25ba7756-d556-4ae3-b718-b2f7595f56f8 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "b84f250c-ee76-451f-bf66-68e25842b7e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.452s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:08 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 39aaebaa-b445-4860-87db-34a835082d28 is timed out.
Nov 19 15:06:08 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully detached device vdb from instance 39aaebaa-b445-4860-87db-34a835082d28 from the live domain config.
Nov 19 15:06:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McdNjQfu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:08 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39cfb7f-3ff9-45ed-8e71-156164c886a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:06:08 user nova-compute[74934]: No targets found.
Nov 19 15:06:08 user nova-compute[74934]: iSNS:
Nov 19 15:06:08 user nova-compute[74934]: No targets found.
Nov 19 15:06:08 user nova-compute[74934]: STATIC:
Nov 19 15:06:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b
Nov 19 15:06:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac
Nov 19 15:06:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:06:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:08 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879
Nov 19 15:06:08 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:08 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:08 user nova-compute[74934]: FIRMWARE:
Nov 19 15:06:08 user nova-compute[74934]: No targets found.
Nov 19 15:06:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:06:08 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:06:08 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff652c-777b-40fa-823c-e1d32528225d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[423d5538-71ae-4fe8-ad1b-a0b97954c24c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:08 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:08 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:06:08 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:08 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:08 user nova-compute[74934]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 (non-flash)
Nov 19 15:06:08 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4155cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3114b91c-2308-4e95-b2a6-7dc8d75996b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f9edc-b97c-43c2-bce3-a0ca59a883f0]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49e4118-bb01-4562-bee8-597b32ae30dd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:06:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e72d777-8246-4b8e-8692-bc565b4e9ea0]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c25b0-c06d-4532-a287-4e7e920d1add]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecc20fd-e625-4a80-94d6-e6a6910d97b5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260]
Nov 19 15:06:09 user nova-compute[74934]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:09 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99057d1a-414b-4cb2-942a-812cda903879 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb4ba4-2671-442c-b141-300bcabf307d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] <== disconnect_volume: return (312ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:06:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAtJsQGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:10 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:10 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:10 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3cc24-7df9-448f-becd-8c2b3886278c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:06:10 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f12453-1290-4d00-835c-23a0e9d400bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2] added
Nov 19 15:06:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'flavor' on Instance uuid 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a2548-3e57-4191-b7cc-f6fa54644fa0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7305a8f-742b-4f5c-ab54-f5f1f30da256]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5fae64ac-5588-4e76-a514-225f5af9060e tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.520s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAtJsQGv {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAtJsQGv" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbbc89e-2c7a-4bd9-8433-ea8469b3a805]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EAtJsQGv'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8818fc7-e893-4d92-b501-e14c0418480a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef59a930-ebc4-4a1e-aab6-9b453417efdc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[108ed2ae-57a7-47aa-9e74-3b96adbb7bcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260]
Nov 19 15:06:10 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d36a91c-b181-4081-b178-74cba7a8483e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa31ccc-6609-46fd-9ec8-adefe39725ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:10 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aafca7a-f355-45e4-91e5-17ce0ee5a33c]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:06:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAtJsQGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:06:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23266353461366464', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266353461366464', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:06:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'flavor' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:06:12 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:12 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:06:12 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:06:12 user nova-compute[74934]:   <serial>eb3bf03e-a022-4852-9201-672d3b5b20f2</serial>
Nov 19 15:06:12 user nova-compute[74934]: </disk>
Nov 19 15:06:12 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:06:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:06:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:06:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No VIF found with MAC fa:16:3e:40:7c:1a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:06:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-24c24d45-d3f1-4de1-89c3-ba7e9c38fcb2 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.884s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG nova.objects.instance [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'flavor' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:16 user nova-compute[74934]: INFO nova.compute.manager [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attaching volume 81255dda-2818-4017-bc1e-02fc119d5bc3 to /dev/vdc
Nov 19 15:06:16 user nova-compute[74934]: DEBUG os_brick.utils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[899483a7-8eb3-4c79-a1c1-54a5361c7234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba9935-abda-4316-abf9-1b97a43c269f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f6e7b0-7751-42fc-ab96-92a0ac6fa3ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[274dc869-6dc4-40e0-88df-abd6f9fa3028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:06:16 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:06:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b563cb8c-9d99-45d8-a445-a2668d97129a]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG os_brick.utils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:16 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating existing volume attachment record: 5cbb98f0-ac50-4bb7-9238-2f852f66c751 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:06:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 is timed out.
Nov 19 15:06:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully detached device vdb from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the live domain config.
Nov 19 15:06:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFiSmZIg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:18 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9735b6-9c6f-4717-899d-42ac431020ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:06:18 user nova-compute[74934]: No targets found.
Nov 19 15:06:18 user nova-compute[74934]: iSNS:
Nov 19 15:06:18 user nova-compute[74934]: No targets found.
Nov 19 15:06:18 user nova-compute[74934]: STATIC:
Nov 19 15:06:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b
Nov 19 15:06:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac
Nov 19 15:06:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:06:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:06:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:18 user nova-compute[74934]: FIRMWARE:
Nov 19 15:06:18 user nova-compute[74934]: No targets found.
Nov 19 15:06:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:06:18 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:06:18 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc07e5a-edd1-4a56-86d6-ddc2dbfd7524]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2091ebd9-764c-426d-92ac-0c952550f4d3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:18 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:18 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:18 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:18 user nova-compute[74934]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b (non-flash)
Nov 19 15:06:18 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:18 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e9ae2-cd3f-4a63-82e3-cc8de9fdad4e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40eb0f2-dec4-4d4f-9c5c-dc9557ae51c6]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:06:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2535f0e-43c7-4562-9db5-fb5d8d61bce8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62c5212-c775-4576-84d6-15e64f997154]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24efe3c4-6dc9-4cd0-a39a-a0ea595415b2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[42575e57-29c4-4a88-9800-b7e7667ba91b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260]
Nov 19 15:06:19 user nova-compute[74934]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0299c0f1-3f1d-48a9-914e-ecbf06e2057b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c2ecf-0f07-4afa-b9d3-d6b991172fe9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== disconnect_volume: return (376ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:06:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c57e6f1c-6daf-4019-a145-520f8230fef9 tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.271s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFGZsWft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:22 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:22 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:22 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc987f-7b2c-4f12-9830-dd3be6ab75a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:06:22 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586d942-a52d-4aa7-9c8c-e409e8482295]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3] added
Nov 19 15:06:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.087s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa7f71a-933c-44ed-8585-3d55ecd96fac]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe1f49-3247-42ac-841b-dc5ef93c55f7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFGZsWft {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eFGZsWft" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[212738a1-dd19-4270-8c64-3b63b3f7a28c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eFGZsWft'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[96894cfb-dd32-4ebb-b743-408f5d7918d9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a4722-2552-48de-b19e-6f11d8682568]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65644bd-80ba-41dc-8ae4-dda3bb85d79a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260]
Nov 19 15:06:22 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa86a2d-86eb-43c6-98b9-29bacecc6c4a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0dbdfc-c536-451f-abbd-ac50fc263638]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)
Nov 19 15:06:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:22 user nova-compute[74934]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)
Nov 19 15:06:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b5d5b-8620-4af7-8646-9e32f71c5307]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:22 user nova-compute[74934]: INFO nova.compute.manager [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Detaching volume 653d7ea3-52fe-417f-85d9-99b4dcecf0ac
Nov 19 15:06:23 user nova-compute[74934]: INFO nova.virt.block_device [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Attempting to driver detach volume 653d7ea3-52fe-417f-85d9-99b4dcecf0ac from mountpoint /dev/vdc
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Attempting to detach device vdc from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:06:23 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:23 user nova-compute[74934]:   <source dev="/dev/sdf"/>
Nov 19 15:06:23 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 15:06:23 user nova-compute[74934]:   <serial>653d7ea3-52fe-417f-85d9-99b4dcecf0ac</serial>
Nov 19 15:06:23 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 19 15:06:23 user nova-compute[74934]: </disk>
Nov 19 15:06:23 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:06:23 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully detached device vdc from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the persistent domain config.
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:06:23 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:23 user nova-compute[74934]:   <source dev="/dev/sdf"/>
Nov 19 15:06:23 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 15:06:23 user nova-compute[74934]:   <serial>653d7ea3-52fe-417f-85d9-99b4dcecf0ac</serial>
Nov 19 15:06:23 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 19 15:06:23 user nova-compute[74934]: </disk>
Nov 19 15:06:23 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFGZsWft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23531366662373662', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531366662373662', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.objects.instance [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'flavor' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:06:23 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:23 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:06:23 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 15:06:23 user nova-compute[74934]:   <serial>81255dda-2818-4017-bc1e-02fc119d5bc3</serial>
Nov 19 15:06:23 user nova-compute[74934]: </disk>
Nov 19 15:06:23 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:06:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:06:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:06:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:06:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] No VIF found with MAC fa:16:3e:40:7c:1a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:06:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-534e854f-d91e-4b6c-8a82-fe34351a1b3f tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.221s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:25 user nova-compute[74934]: INFO nova.compute.manager [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Detaching volume 81255dda-2818-4017-bc1e-02fc119d5bc3
Nov 19 15:06:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:25 user nova-compute[74934]: INFO nova.virt.block_device [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attempting to driver detach volume 81255dda-2818-4017-bc1e-02fc119d5bc3 from mountpoint /dev/vdc
Nov 19 15:06:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Attempting to detach device vdc from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:06:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:06:25 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:25 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:06:25 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 15:06:25 user nova-compute[74934]:   <serial>81255dda-2818-4017-bc1e-02fc119d5bc3</serial>
Nov 19 15:06:25 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 19 15:06:25 user nova-compute[74934]: </disk>
Nov 19 15:06:25 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:06:25 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Successfully detached device vdc from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the persistent domain config.
Nov 19 15:06:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:06:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:06:25 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:25 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:06:25 user nova-compute[74934]:   <target dev="vdc" bus="virtio"/>
Nov 19 15:06:25 user nova-compute[74934]:   <serial>81255dda-2818-4017-bc1e-02fc119d5bc3</serial>
Nov 19 15:06:25 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 19 15:06:25 user nova-compute[74934]: </disk>
Nov 19 15:06:25 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:06:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:06:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:38 user nova-compute[74934]: INFO nova.compute.manager [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Terminating instance
Nov 19 15:06:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-cf79c1bb-4ec7-4d6b-9877-b4c2cd0a31c3 req-1fe2efa5-b3d2-477a-a8b8-4093ccd49920 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-vif-unplugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cf79c1bb-4ec7-4d6b-9877-b4c2cd0a31c3 req-1fe2efa5-b3d2-477a-a8b8-4093ccd49920 service nova] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cf79c1bb-4ec7-4d6b-9877-b4c2cd0a31c3 req-1fe2efa5-b3d2-477a-a8b8-4093ccd49920 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cf79c1bb-4ec7-4d6b-9877-b4c2cd0a31c3 req-1fe2efa5-b3d2-477a-a8b8-4093ccd49920 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-cf79c1bb-4ec7-4d6b-9877-b4c2cd0a31c3 req-1fe2efa5-b3d2-477a-a8b8-4093ccd49920 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] No waiting events found dispatching network-vif-unplugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-cf79c1bb-4ec7-4d6b-9877-b4c2cd0a31c3 req-1fe2efa5-b3d2-477a-a8b8-4093ccd49920 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-vif-unplugged-80b59d4a-d7d6-4adb-8124-083498d14e16 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:06:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Instance destroyed successfully.
Nov 19 15:06:39 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lazy-loading 'resources' on Instance uuid 39aaebaa-b445-4860-87db-34a835082d28 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1565667026',display_name='tempest-AttachVolumeNegativeTest-server-1565667026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1565667026',id=37,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNqJ9P8MX6aXTrvZDVxJs2fx2jLN9MNUzXeF/IJ4DBl3UmFVidGdxOpVffJ+QCP5AaWyIam7M67wsd3+DKf5qZrlatGSyAgN8dNB/NCP3VGDJ/Cy6xcmBerbCVCSiGg2g==',key_name='tempest-keypair-995377627',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8926ff675c045458069f7b4e1ebc656',ramdisk_id='',reservation_id='r-o1i9wqe0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-661612303',owner_user_name='tempest-AttachVolumeNegativeTest-661612303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124c5ebfa08e42e49e2e9d244103a1f4',uuid=39aaebaa-b445-4860-87db-34a835082d28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converting VIF {"id": "80b59d4a-d7d6-4adb-8124-083498d14e16", "address": "fa:16:3e:39:00:18", "network": {"id": "87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1017540348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8926ff675c045458069f7b4e1ebc656", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80b59d4a-d7", "ovs_interfaceid": "80b59d4a-d7d6-4adb-8124-083498d14e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG os_vif [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80b59d4a-d7, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a229768-7478-4642-a337-efcf290b9014) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:39 user nova-compute[74934]: INFO os_vif [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:00:18,bridge_name='br-int',has_traffic_filtering=True,id=80b59d4a-d7d6-4adb-8124-083498d14e16,network=Network(87cfd3c4-3a7d-4727-8ffc-b31eb8a9ed85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80b59d4a-d7')
Nov 19 15:06:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Deleting instance files /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28_del
Nov 19 15:06:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Deletion of /opt/stack/data/nova/instances/39aaebaa-b445-4860-87db-34a835082d28_del complete
Nov 19 15:06:39 user nova-compute[74934]: INFO nova.compute.manager [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 19 15:06:39 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:06:39 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 39aaebaa-b445-4860-87db-34a835082d28] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:40 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Took 0.66 seconds to deallocate network for instance.
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:40 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Deleted allocations for instance 39aaebaa-b445-4860-87db-34a835082d28
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b3918f9c-64ee-44ff-92a7-82a97a123145 tempest-AttachVolumeNegativeTest-661612303 tempest-AttachVolumeNegativeTest-661612303-project-member] Lock "39aaebaa-b445-4860-87db-34a835082d28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.026s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] Acquiring lock "39aaebaa-b445-4860-87db-34a835082d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] Lock "39aaebaa-b445-4860-87db-34a835082d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] No waiting events found dispatching network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:40 user nova-compute[74934]: WARNING nova.compute.manager [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received unexpected event network-vif-plugged-80b59d4a-d7d6-4adb-8124-083498d14e16 for instance with vm_state deleted and task_state None.
Nov 19 15:06:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-8755d5ae-6dc7-4706-b7d1-e8a937736131 req-13584267-921b-4f2b-8d24-4f81aeeaf161 service nova] [instance: 39aaebaa-b445-4860-87db-34a835082d28] Received event network-vif-deleted-80b59d4a-d7d6-4adb-8124-083498d14e16 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:43 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 is timed out.
Nov 19 15:06:43 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully detached device vdc from instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2 from the live domain config.
Nov 19 15:06:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoVFhHQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:43 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e618bec-a6be-47b4-bdc2-303ed1fc6faf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:06:43 user nova-compute[74934]: No targets found.
Nov 19 15:06:43 user nova-compute[74934]: iSNS:
Nov 19 15:06:43 user nova-compute[74934]: No targets found.
Nov 19 15:06:43 user nova-compute[74934]: STATIC:
Nov 19 15:06:43 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac
Nov 19 15:06:43 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:43 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:43 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:06:43 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:43 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:43 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:06:43 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:43 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:43 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3
Nov 19 15:06:43 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:43 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:43 user nova-compute[74934]: FIRMWARE:
Nov 19 15:06:43 user nova-compute[74934]: No targets found.
Nov 19 15:06:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:06:43 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:06:43 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[817ad569-1ddd-409b-b8cd-c6c85338b4d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1564fc7b-1f96-4419-87df-5921f8d79e72]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:43 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:43 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:43 user nova-compute[74934]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)
Nov 19 15:06:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:43 user nova-compute[74934]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac (non-flash)
Nov 19 15:06:43 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:43 user nova-compute[74934]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)
Nov 19 15:06:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c424f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac'): ({'sdf'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Removing single pathed devices sdf {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[833c09ef-d563-42cf-a823-59ba5be826ae]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8ba263-9caf-4f3f-bbe6-79baa636d5eb]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Flushing IO for device /dev/sdf {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bd3e3d-5689-4a96-9dd9-ce45787dbffa]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f3effc-9c33-4452-bbdb-02a28a4d9299]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] SCSI volumes sdf have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b2b33-077e-4fc5-8ef5-3a43928a128b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c05446-763b-4593-9a82-6caa7916a5fa]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260]
Nov 19 15:06:43 user nova-compute[74934]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:43 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:653d7ea3-52fe-417f-85d9-99b4dcecf0ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97128cc-37e7-4357-834f-42413f2e24a6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] <== disconnect_volume: return (288ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:06:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:44 user nova-compute[74934]: DEBUG nova.objects.instance [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'flavor' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-af76ca44-45ec-4a48-ae18-8dae03c75e9c tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.593s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "da022f2a-df63-4188-879b-9c6d2530f242" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:44 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:06:45 user nova-compute[74934]: INFO nova.compute.claims [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Claim successful on node user
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:06:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.policy [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ade11c889684ca9b402fa1066e4b629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441622bd90c1460fb78ac8ebdbead719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:06:45 user nova-compute[74934]: INFO nova.virt.block_device [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Booting with volume snapshot 7cb212f8-8bcf-4e72-aab9-437ce9102dab at /dev/vda
Nov 19 15:06:45 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 is timed out.
Nov 19 15:06:45 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Successfully detached device vdc from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the live domain config.
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eFGZsWft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:45 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aabce3f-123b-407b-9415-c4ea1432786c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:06:45 user nova-compute[74934]: No targets found.
Nov 19 15:06:45 user nova-compute[74934]: iSNS:
Nov 19 15:06:45 user nova-compute[74934]: No targets found.
Nov 19 15:06:45 user nova-compute[74934]: STATIC:
Nov 19 15:06:45 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:06:45 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:45 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:45 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:06:45 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:45 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:45 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3
Nov 19 15:06:45 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:45 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:45 user nova-compute[74934]: FIRMWARE:
Nov 19 15:06:45 user nova-compute[74934]: No targets found.
Nov 19 15:06:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:06:45 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:06:45 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e359f3c-9a30-4fcf-81fc-6e9ae39c5211]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0fb40b-4ff6-4227-acf1-c0056972e876]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:45 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:45 user nova-compute[74934]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)
Nov 19 15:06:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:45 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:45 user nova-compute[74934]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 (non-flash)
Nov 19 15:06:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c424d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4677a4-95ac-46a1-b52d-a1b8fde13d02]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba3dc2b-fa98-4a3c-9fce-5368331a1f5d]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99301aa-f1e2-41b6-8881-66dd713a6339]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7abbea-a24e-4a2e-8419-7f2c9eb5ea2e]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:06:45 user nova-compute[74934]: INFO nova.compute.manager [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Terminating instance
Nov 19 15:06:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6143ee9-019d-462b-a8ad-e929e29825d7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aaec95-25d8-464d-ba68-8fe260b7bf52]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260]
Nov 19 15:06:46 user nova-compute[74934]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:46 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81255dda-2818-4017-bc1e-02fc119d5bc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7bfadc-fc72-478a-b3b5-5c4142b13d0f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] <== disconnect_volume: return (374ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Successfully created port: 6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.compute.manager [req-85392f26-fb30-4841-80b2-d1838ed17de6 req-30d02389-fd80-4b2b-8824-98891f6ffabc service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-vif-unplugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85392f26-fb30-4841-80b2-d1838ed17de6 req-30d02389-fd80-4b2b-8824-98891f6ffabc service nova] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85392f26-fb30-4841-80b2-d1838ed17de6 req-30d02389-fd80-4b2b-8824-98891f6ffabc service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85392f26-fb30-4841-80b2-d1838ed17de6 req-30d02389-fd80-4b2b-8824-98891f6ffabc service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.compute.manager [req-85392f26-fb30-4841-80b2-d1838ed17de6 req-30d02389-fd80-4b2b-8824-98891f6ffabc service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] No waiting events found dispatching network-vif-unplugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.compute.manager [req-85392f26-fb30-4841-80b2-d1838ed17de6 req-30d02389-fd80-4b2b-8824-98891f6ffabc service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-vif-unplugged-8ad1b074-aba2-4905-943d-5694480f9631 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:06:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Instance destroyed successfully.
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.objects.instance [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lazy-loading 'resources' on Instance uuid 920e8234-66a1-43a8-bc6a-b3a4d31341c2 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-890737702',display_name='tempest-AttachVolumeTestJSON-server-890737702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-890737702',id=38,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCm/c8rap4WTv/paQVBmpEqM/c58nw9FFgabJ3etWQCueVBjk2xe7wvMGUDyvXDaPTLhocn3E9RG1tqa6ZaLixyPMw/VJf3K6G0OpXejiB5wJayBk2fSKTA44JwchvllVQ==',key_name='tempest-keypair-364835346',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd008f473dc744a9bc9f1ebc2f4cb95d',ramdisk_id='',reservation_id='r-d11dxfoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-980904147',owner_user_name='tempest-AttachVolumeTestJSON-980904147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eda5707b8cd7412098e9d0b3e4bdc536',uuid=920e8234-66a1-43a8-bc6a-b3a4d31341c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converting VIF {"id": "8ad1b074-aba2-4905-943d-5694480f9631", "address": "fa:16:3e:3d:a0:7f", "network": {"id": "cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1210170879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd008f473dc744a9bc9f1ebc2f4cb95d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ad1b074-ab", "ovs_interfaceid": "8ad1b074-aba2-4905-943d-5694480f9631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG os_vif [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ad1b074-ab, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e982ed6-2e29-4988-b3f3-fff8c683b101) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:46 user nova-compute[74934]: INFO os_vif [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a0:7f,bridge_name='br-int',has_traffic_filtering=True,id=8ad1b074-aba2-4905-943d-5694480f9631,network=Network(cb8d8fb0-7fcd-4c5b-b3aa-4584f9bb0f53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ad1b074-ab')
Nov 19 15:06:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Deleting instance files /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2_del
Nov 19 15:06:46 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Deletion of /opt/stack/data/nova/instances/920e8234-66a1-43a8-bc6a-b3a4d31341c2_del complete
Nov 19 15:06:46 user nova-compute[74934]: INFO nova.compute.manager [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'flavor' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6b4008b6-6646-4fbf-8c8d-e93cb4dad34e tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Successfully updated port: 6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "refresh_cache-da022f2a-df63-4188-879b-9c6d2530f242" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquired lock "refresh_cache-da022f2a-df63-4188-879b-9c6d2530f242" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG nova.network.neutron [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Updating instance_info_cache with network_info: [{"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Releasing lock "refresh_cache-da022f2a-df63-4188-879b-9c6d2530f242" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Instance network_info: |[{"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:47 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Took 1.10 seconds to deallocate network for instance.
Nov 19 15:06:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] Acquiring lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] No waiting events found dispatching network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:48 user nova-compute[74934]: WARNING nova.compute.manager [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received unexpected event network-vif-plugged-8ad1b074-aba2-4905-943d-5694480f9631 for instance with vm_state deleted and task_state None.
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-changed-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Refreshing instance network info cache due to event network-changed-6d337acc-92cb-4064-99cd-205a310116e7. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] Acquiring lock "refresh_cache-da022f2a-df63-4188-879b-9c6d2530f242" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] Acquired lock "refresh_cache-da022f2a-df63-4188-879b-9c6d2530f242" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.network.neutron [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Refreshing network info cache for port 6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:06:48 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Deleted allocations for instance 920e8234-66a1-43a8-bc6a-b3a4d31341c2
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-628fa67c-c39f-4bc1-9a07-c758b3d55cdf tempest-AttachVolumeTestJSON-980904147 tempest-AttachVolumeTestJSON-980904147-project-member] Lock "920e8234-66a1-43a8-bc6a-b3a4d31341c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.network.neutron [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Updated VIF entry in instance network info cache for port 6d337acc-92cb-4064-99cd-205a310116e7. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.network.neutron [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Updating instance_info_cache with network_info: [{"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] Releasing lock "refresh_cache-da022f2a-df63-4188-879b-9c6d2530f242" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:06:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-e8203f61-2e6b-41d0-9b08-4e7dbd6f5bc4 req-d434d170-e767-4999-9c25-39441cc40588 service nova] [instance: 920e8234-66a1-43a8-bc6a-b3a4d31341c2] Received event network-vif-deleted-8ad1b074-aba2-4905-943d-5694480f9631 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:49 user nova-compute[74934]: INFO nova.compute.manager [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Terminating instance
Nov 19 15:06:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Instance destroyed successfully.
Nov 19 15:06:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'resources' on Instance uuid f1546e24-c8ba-40b9-81f9-084ab10c9a31 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:51:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1820545125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1820545125',id=14,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:53:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-229itr1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:54:48Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=f1546e24-c8ba-40b9-81f9-084ab10c9a31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "address": "fa:16:3e:99:bf:09", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5401bfd-da", "ovs_interfaceid": "d5401bfd-dacc-4573-b48f-16f6cac437e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_vif [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5401bfd-da, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a955f97-9787-47a8-92eb-65ecf6ad9eed) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:49 user nova-compute[74934]: INFO os_vif [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:bf:09,bridge_name='br-int',has_traffic_filtering=True,id=d5401bfd-dacc-4573-b48f-16f6cac437e6,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5401bfd-da')
Nov 19 15:06:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOlRnrVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcb7dd3-519b-449f-bdcc-cddff4fff517]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:06:49 user nova-compute[74934]: No targets found.
Nov 19 15:06:49 user nova-compute[74934]: iSNS:
Nov 19 15:06:49 user nova-compute[74934]: No targets found.
Nov 19 15:06:49 user nova-compute[74934]: STATIC:
Nov 19 15:06:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc
Nov 19 15:06:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:06:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:06:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:06:49 user nova-compute[74934]: FIRMWARE:
Nov 19 15:06:49 user nova-compute[74934]: No targets found.
Nov 19 15:06:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:06:49 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:06:49 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8102e038-b012-41b3-afee-737e48322dee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2a06c-3ece-4de0-bc74-9f0879fc8e87]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:49 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc (non-flash)
Nov 19 15:06:49 user nova-compute[74934]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa0963-4274-4cec-8906-5540509a9da7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd952d64-508e-48d7-99a0-ff8753091fc8]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f5496f-4135-4863-911e-076ca290d3ed]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[875f1f35-2dd5-4fc3-96d5-d247cfad6d11]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa73e8-8e23-4a84-9456-a1e2c8ad1c18]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[78529f74-617c-4839-b5f0-2866271adadc]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260]
Nov 19 15:06:50 user nova-compute[74934]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:209acf5b-0510-43d2-b195-0e2b368807dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[199841b4-3c56-4c43-8d41-fef714eb0756]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] <== disconnect_volume: return (300ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:06:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Deleting instance files /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31_del
Nov 19 15:06:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Deletion of /opt/stack/data/nova/instances/f1546e24-c8ba-40b9-81f9-084ab10c9a31_del complete
Nov 19 15:06:50 user nova-compute[74934]: INFO nova.compute.manager [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-unplugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] Acquiring lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] No waiting events found dispatching network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:50 user nova-compute[74934]: WARNING nova.compute.manager [req-9a942c66-1634-40bd-af47-c1b4a32a1ab0 req-f8bfd5fb-0acd-4f4d-8f32-37def5b5018c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received unexpected event network-vif-plugged-d5401bfd-dacc-4573-b48f-16f6cac437e6 for instance with vm_state active and task_state deleting.
Nov 19 15:06:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:50 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Took 0.66 seconds to deallocate network for instance.
Nov 19 15:06:51 user nova-compute[74934]: DEBUG os_brick.utils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de7a870-341f-461e-997e-407b07e84b69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d14657-78a3-48ba-ac06-a5e439fd2166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b336e9a-a0d8-4f50-9d29-5ef4a3c77af4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e3e828-d772-4bb2-b012-a70ff0bf7ede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:06:51 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b643acbe-9064-4535-83cd-bcae3a0e8fc4]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG os_brick.utils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Updating existing volume attachment record: 349f68f7-d562-4270-b5c9-ad2a48e41c0b {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:06:51 user nova-compute[74934]: INFO nova.compute.manager [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Took 0.71 seconds to detach 1 volumes for instance.
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:06:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:52 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Deleted allocations for instance f1546e24-c8ba-40b9-81f9-084ab10c9a31
Nov 19 15:06:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ae0a892-090a-4961-a24c-0dd093c494d3 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "f1546e24-c8ba-40b9-81f9-084ab10c9a31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-1d354a0b-25f5-4f25-880d-cdc6dc0ce756 req-37f977df-3555-4874-b894-ae884163b88c service nova] [instance: f1546e24-c8ba-40b9-81f9-084ab10c9a31] Received event network-vif-deleted-d5401bfd-dacc-4573-b48f-16f6cac437e6 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:06:56 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Creating image(s)
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Ensure instance console log exists: /opt/stack/data/nova/instances/da022f2a-df63-4188-879b-9c6d2530f242/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Start _get_guest_xml network_info=[{"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '349f68f7-d562-4270-b5c9-ad2a48e41c0b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpSPJtDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da022f2a-df63-4188-879b-9c6d2530f242', 'attached_at': '', 'detached_at': '', 'volume_id': '2786f45d-2b0c-46d5-8ee4-f20211fe4521', 'serial': '2786f45d-2b0c-46d5-8ee4-f20211fe4521'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:06:56 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:06:56 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:06:56 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpSPJtDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:06:57 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:57 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:06:57 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1637169d-1ac6-44cc-9145-12e5432a34db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:06:57 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7330a-1130-4001-9f99-1173df17b4d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521] added
Nov 19 15:06:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d42613-9772-46e6-97b1-43ca0892edc0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11a2e8-9efd-4650-b940-dc7766549f56]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpSPJtDK {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EpSPJtDK" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bfbc75-9f07-476a-a22d-33eeddb12b02]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EpSPJtDK'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c158b20f-34bd-4887-b7b0-3511874ca54e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f19a6-6e50-4781-9229-b0d59a7669c7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3b6e3-59e3-4cc7-8137-4f6525541de9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260]
Nov 19 15:06:57 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260] successful.
Nov 19 15:06:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b364df-4751-4a8d-beaf-d61dd7dc632a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f2f37f-e0f1-4ecb-b4b6-8ab32e859479]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:57 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:06:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:06:57 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:06:57 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dae5076-955c-42ed-aa92-11ba34aab917]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpSPJtDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:06:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:58 user nova-compute[74934]: INFO nova.compute.manager [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Terminating instance
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.compute.manager [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26234326533363635', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234326533363635', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013825291',display_name='tempest-TestVolumeBootPattern-server-2013825291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013825291',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-fyf04ydx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:06:46Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=da022f2a-df63-4188-879b-9c6d2530f242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.objects.instance [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'pci_devices' on Instance uuid da022f2a-df63-4188-879b-9c6d2530f242 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:06:58 user nova-compute[74934]:   <uuid>da022f2a-df63-4188-879b-9c6d2530f242</uuid>
Nov 19 15:06:58 user nova-compute[74934]:   <name>instance-00000029</name>
Nov 19 15:06:58 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:06:58 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:06:58 user nova-compute[74934]:   <metadata>
Nov 19 15:06:58 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:06:58 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:06:58 user nova-compute[74934]:       <nova:name>tempest-TestVolumeBootPattern-server-2013825291</nova:name>
Nov 19 15:06:58 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:06:56</nova:creationTime>
Nov 19 15:06:58 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:06:58 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:06:58 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:06:58 user nova-compute[74934]:       <nova:owner>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:user uuid="3ade11c889684ca9b402fa1066e4b629">tempest-TestVolumeBootPattern-686579107-project-member</nova:user>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:project uuid="441622bd90c1460fb78ac8ebdbead719">tempest-TestVolumeBootPattern-686579107</nova:project>
Nov 19 15:06:58 user nova-compute[74934]:       </nova:owner>
Nov 19 15:06:58 user nova-compute[74934]:       <nova:ports>
Nov 19 15:06:58 user nova-compute[74934]:         <nova:port uuid="6d337acc-92cb-4064-99cd-205a310116e7">
Nov 19 15:06:58 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 19 15:06:58 user nova-compute[74934]:         </nova:port>
Nov 19 15:06:58 user nova-compute[74934]:       </nova:ports>
Nov 19 15:06:58 user nova-compute[74934]:     </nova:instance>
Nov 19 15:06:58 user nova-compute[74934]:   </metadata>
Nov 19 15:06:58 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:06:58 user nova-compute[74934]:     <system>
Nov 19 15:06:58 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:06:58 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:06:58 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:06:58 user nova-compute[74934]:       <entry name="serial">da022f2a-df63-4188-879b-9c6d2530f242</entry>
Nov 19 15:06:58 user nova-compute[74934]:       <entry name="uuid">da022f2a-df63-4188-879b-9c6d2530f242</entry>
Nov 19 15:06:58 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:06:58 user nova-compute[74934]:     </system>
Nov 19 15:06:58 user nova-compute[74934]:   </sysinfo>
Nov 19 15:06:58 user nova-compute[74934]:   <os>
Nov 19 15:06:58 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:06:58 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:06:58 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:06:58 user nova-compute[74934]:   </os>
Nov 19 15:06:58 user nova-compute[74934]:   <features>
Nov 19 15:06:58 user nova-compute[74934]:     <acpi/>
Nov 19 15:06:58 user nova-compute[74934]:     <apic/>
Nov 19 15:06:58 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:06:58 user nova-compute[74934]:   </features>
Nov 19 15:06:58 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:06:58 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:06:58 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:06:58 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:06:58 user nova-compute[74934]:   </clock>
Nov 19 15:06:58 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:06:58 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:06:58 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:06:58 user nova-compute[74934]:   </cpu>
Nov 19 15:06:58 user nova-compute[74934]:   <devices>
Nov 19 15:06:58 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:06:58 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:06:58 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 15:06:58 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:06:58 user nova-compute[74934]:       <serial>2786f45d-2b0c-46d5-8ee4-f20211fe4521</serial>
Nov 19 15:06:58 user nova-compute[74934]:     </disk>
Nov 19 15:06:58 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:06:58 user nova-compute[74934]:       <mac address="fa:16:3e:72:42:82"/>
Nov 19 15:06:58 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:06:58 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:06:58 user nova-compute[74934]:       <target dev="tap6d337acc-92"/>
Nov 19 15:06:58 user nova-compute[74934]:     </interface>
Nov 19 15:06:58 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:06:58 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/da022f2a-df63-4188-879b-9c6d2530f242/console.log" append="off"/>
Nov 19 15:06:58 user nova-compute[74934]:     </serial>
Nov 19 15:06:58 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:06:58 user nova-compute[74934]:     <video>
Nov 19 15:06:58 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:06:58 user nova-compute[74934]:     </video>
Nov 19 15:06:58 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:06:58 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:06:58 user nova-compute[74934]:     </rng>
Nov 19 15:06:58 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:06:58 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:06:58 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:06:58 user nova-compute[74934]:     </memballoon>
Nov 19 15:06:58 user nova-compute[74934]:   </devices>
Nov 19 15:06:58 user nova-compute[74934]: </domain>
Nov 19 15:06:58 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013825291',display_name='tempest-TestVolumeBootPattern-server-2013825291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013825291',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-fyf04ydx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:06:46Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=da022f2a-df63-4188-879b-9c6d2530f242,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG os_vif [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23f495ae-4f30-593d-9c83-86bb83e0a189', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d337acc-92, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d337acc-92, col_values=(('qos', UUID('0e6d447d-d8d9-415a-9479-706f6863b3c1')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d337acc-92, col_values=(('external_ids', {'iface-id': '6d337acc-92cb-4064-99cd-205a310116e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:42:82', 'vm-uuid': 'da022f2a-df63-4188-879b-9c6d2530f242'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: INFO os_vif [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92')
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-f6d912fe-f5f2-4261-b432-c44d215dd631 req-b963a259-aa9a-411a-a2c1-e5584f8acb8f service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-unplugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f6d912fe-f5f2-4261-b432-c44d215dd631 req-b963a259-aa9a-411a-a2c1-e5584f8acb8f service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f6d912fe-f5f2-4261-b432-c44d215dd631 req-b963a259-aa9a-411a-a2c1-e5584f8acb8f service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f6d912fe-f5f2-4261-b432-c44d215dd631 req-b963a259-aa9a-411a-a2c1-e5584f8acb8f service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-f6d912fe-f5f2-4261-b432-c44d215dd631 req-b963a259-aa9a-411a-a2c1-e5584f8acb8f service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-unplugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-f6d912fe-f5f2-4261-b432-c44d215dd631 req-b963a259-aa9a-411a-a2c1-e5584f8acb8f service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-unplugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No VIF found with MAC fa:16:3e:72:42:82, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Instance destroyed successfully.
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lazy-loading 'resources' on Instance uuid 76da41ee-9c9b-4086-863d-7e6d3f3789b4 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1252279141',display_name='tempest-ServerActionsTestOtherA-server-1252279141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1252279141',id=2,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZwDqNWHBvcksji0DOMSJOmtoQzGfwSlSw7ny/dEdhhoSchR4Xi5H6FPHOVluVKCFn+Mpse2vK9fz428jEaOIOElfat4RWeQ//IKQq/zaWPIh79t2yQzDWqIcBQHuzFQg==',key_name='tempest-keypair-1313432207',keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd2d42525428465c90522337ec5a4b82',ramdisk_id='',reservation_id='r-7yzfhnsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-463456576',owner_user_name='tempest-ServerActionsTestOtherA-463456576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:48:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77319d6b70b24f22b39342f6955a8fef',uuid=76da41ee-9c9b-4086-863d-7e6d3f3789b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converting VIF {"id": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "address": "fa:16:3e:e5:a9:4b", "network": {"id": "02d9f149-8fac-424c-affd-d8de8e57456e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-760124211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd2d42525428465c90522337ec5a4b82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd3c8114-6b", "ovs_interfaceid": "bd3c8114-6b3f-4adf-820a-42f5197fc7b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG os_vif [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd3c8114-6b, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fad69274-8b30-4943-9cad-f6a49462249c) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: INFO os_vif [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:4b,bridge_name='br-int',has_traffic_filtering=True,id=bd3c8114-6b3f-4adf-820a-42f5197fc7b4,network=Network(02d9f149-8fac-424c-affd-d8de8e57456e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd3c8114-6b')
Nov 19 15:06:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Deleting instance files /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4_del
Nov 19 15:06:59 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Deletion of /opt/stack/data/nova/instances/76da41ee-9c9b-4086-863d-7e6d3f3789b4_del complete
Nov 19 15:06:59 user nova-compute[74934]: INFO nova.compute.manager [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 19 15:06:59 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:06:59 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Took 0.65 seconds to deallocate network for instance.
Nov 19 15:06:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-3bea050f-756e-46eb-87d0-101952080a62 req-8eb3fe6c-0f16-4e6f-9f3e-da85d4e1e128 service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-deleted-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:06:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Deleted allocations for instance 76da41ee-9c9b-4086-863d-7e6d3f3789b4
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c5dc46c5-2477-4094-be48-7c01226d94f5 tempest-ServerActionsTestOtherA-463456576 tempest-ServerActionsTestOtherA-463456576-project-member] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state deleted and task_state None.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state deleted and task_state None.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state deleted and task_state None.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-unplugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-unplugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-unplugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state deleted and task_state None.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "76da41ee-9c9b-4086-863d-7e6d3f3789b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] No waiting events found dispatching network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: 76da41ee-9c9b-4086-863d-7e6d3f3789b4] Received unexpected event network-vif-plugged-bd3c8114-6b3f-4adf-820a-42f5197fc7b4 for instance with vm_state deleted and task_state None.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] No waiting events found dispatching network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received unexpected event network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 for instance with vm_state building and task_state spawning.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] No waiting events found dispatching network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:00 user nova-compute[74934]: WARNING nova.compute.manager [req-3a115899-4924-4d42-b0e9-8f417a4fe006 req-0955e0e5-3de5-4d28-a22b-e675f3916bef service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received unexpected event network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 for instance with vm_state building and task_state spawning.
Nov 19 15:07:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-changed-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Refreshing instance network info cache due to event network-changed-285f4f66-d166-45a0-b144-2c7764235d78. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] Acquiring lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] Acquired lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG nova.network.neutron [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Refreshing network info cache for port 285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:07:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'flavor' on Instance uuid f22d32e5-e4b4-497e-bba7-affbd725831f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:01 user nova-compute[74934]: INFO nova.compute.manager [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Attaching volume 04c3a881-cff6-4d75-bcdc-8c979f5e3f71 to /dev/vdb
Nov 19 15:07:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updated VIF entry in instance network info cache for port 285f4f66-d166-45a0-b144-2c7764235d78. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updating instance_info_cache with network_info: [{"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7785bbb8-47bb-4905-91ef-08b31c172f14 req-5f174202-cb1e-44fc-be91-5c0cae0ee65e service nova] Releasing lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG os_brick.utils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[71892f69-6301-4fa6-8a98-e83e0490a258]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02824f-5501-4fbf-9058-ea8d51cb623f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c69092-d25c-4edf-a579-cbda54f5c47f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[255b084c-4042-4a8b-91c6-353c1548b5c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:07:01 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:07:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffc19f8-d3f2-43ff-b1aa-6606a7a8499d]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG os_brick.utils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:07:01 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updating existing volume attachment record: c0917c77-1f8f-4124-8b94-77c03b0c4a2f {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:07:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Instance spawned successfully.
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:07:02 user nova-compute[74934]: INFO nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:07:02 user nova-compute[74934]: INFO nova.compute.manager [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Took 17.19 seconds to build instance.
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-b2248a9a-097a-4f11-b488-8da377b81d87 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "da022f2a-df63-4188-879b-9c6d2530f242" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.306s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:07:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:07:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:07:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=24.952056884765625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance f22d32e5-e4b4-497e-bba7-affbd725831f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance da022f2a-df63-4188-879b-9c6d2530f242 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:07:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating instance_info_cache with network_info: [{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfIzWRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:07:07 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:07:07 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:07:07 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea0f13f-d05a-4cc9-bb88-480cf8445037]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:07:07 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0320d6-bd86-494d-835b-f61aff3710b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71] added
Nov 19 15:07:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c92ce9-0745-4ccc-92ee-e8521b1deabd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de3195-36d8-4ce2-bec7-af5fd42ef417]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfIzWRDm {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfIzWRDm" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d2df2-21aa-4275-b324-36f7d2c76014]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sfIzWRDm'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9650f5ca-9b62-4d4d-a953-1e2e02090935]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eff515-f306-4c40-88ac-8c995b6cdb2e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e8f415-ec97-4227-b144-42654a5370f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260]
Nov 19 15:07:07 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260] successful.
Nov 19 15:07:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4343d1e-9bc1-4410-85b4-8045cb68f05d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf629bc3-cdf2-4d58-ac08-6efd3fb3f84a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 (non-flash)
Nov 19 15:07:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f4826-cf92-4c95-89dc-3cc5b11fb4fe]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:07:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfIzWRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:07:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:07:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26339396166383136', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:07:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339396166383136', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:07:08 user nova-compute[74934]: DEBUG nova.objects.instance [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'flavor' on Instance uuid f22d32e5-e4b4-497e-bba7-affbd725831f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:07:08 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:07:08 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:07:08 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:07:08 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:07:08 user nova-compute[74934]:   <serial>04c3a881-cff6-4d75-bcdc-8c979f5e3f71</serial>
Nov 19 15:07:08 user nova-compute[74934]: </disk>
Nov 19 15:07:08 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:07:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:07:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:07:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] No VIF found with MAC fa:16:3e:b5:3d:eb, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:07:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-d56c8f85-704e-49eb-98b0-10f31fb3cd8e tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.967s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:11 user nova-compute[74934]: INFO nova.compute.manager [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Detaching volume 04c3a881-cff6-4d75-bcdc-8c979f5e3f71
Nov 19 15:07:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:11 user nova-compute[74934]: INFO nova.virt.block_device [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Attempting to driver detach volume 04c3a881-cff6-4d75-bcdc-8c979f5e3f71 from mountpoint /dev/vdb
Nov 19 15:07:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Attempting to detach device vdb from instance f22d32e5-e4b4-497e-bba7-affbd725831f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:07:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:07:11 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:07:11 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:07:11 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:07:11 user nova-compute[74934]:   <serial>04c3a881-cff6-4d75-bcdc-8c979f5e3f71</serial>
Nov 19 15:07:11 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:07:11 user nova-compute[74934]: </disk>
Nov 19 15:07:11 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:07:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully detached device vdb from instance f22d32e5-e4b4-497e-bba7-affbd725831f from the persistent domain config.
Nov 19 15:07:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f22d32e5-e4b4-497e-bba7-affbd725831f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:07:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:07:11 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:07:11 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:07:11 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:07:11 user nova-compute[74934]:   <serial>04c3a881-cff6-4d75-bcdc-8c979f5e3f71</serial>
Nov 19 15:07:11 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:07:11 user nova-compute[74934]: </disk>
Nov 19 15:07:11 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:07:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f22d32e5-e4b4-497e-bba7-affbd725831f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:07:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:15 user nova-compute[74934]: INFO nova.compute.manager [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Detaching volume eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:07:15 user nova-compute[74934]: INFO nova.virt.block_device [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Attempting to driver detach volume eb3bf03e-a022-4852-9201-672d3b5b20f2 from mountpoint /dev/vdb
Nov 19 15:07:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Attempting to detach device vdb from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:07:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:07:15 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:07:15 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:07:15 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:07:15 user nova-compute[74934]:   <serial>eb3bf03e-a022-4852-9201-672d3b5b20f2</serial>
Nov 19 15:07:15 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:07:15 user nova-compute[74934]: </disk>
Nov 19 15:07:15 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:07:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Successfully detached device vdb from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the persistent domain config.
Nov 19 15:07:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:07:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:07:15 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:07:15 user nova-compute[74934]:   <source dev="/dev/sdd"/>
Nov 19 15:07:15 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:07:15 user nova-compute[74934]:   <serial>eb3bf03e-a022-4852-9201-672d3b5b20f2</serial>
Nov 19 15:07:15 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:07:15 user nova-compute[74934]: </disk>
Nov 19 15:07:15 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:07:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:07:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f22d32e5-e4b4-497e-bba7-affbd725831f is timed out.
Nov 19 15:07:31 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully detached device vdb from instance f22d32e5-e4b4-497e-bba7-affbd725831f from the live domain config.
Nov 19 15:07:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfIzWRDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:07:31 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:07:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7135f56-309b-4442-bf16-9812139af4df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:07:31 user nova-compute[74934]: No targets found.
Nov 19 15:07:31 user nova-compute[74934]: iSNS:
Nov 19 15:07:31 user nova-compute[74934]: No targets found.
Nov 19 15:07:31 user nova-compute[74934]: STATIC:
Nov 19 15:07:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71
Nov 19 15:07:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:07:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:07:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:07:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:07:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:07:31 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521
Nov 19 15:07:31 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:07:31 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:07:31 user nova-compute[74934]: FIRMWARE:
Nov 19 15:07:31 user nova-compute[74934]: No targets found.
Nov 19 15:07:31 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:07:31 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:07:31 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:07:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab75b7-6a87-42f6-b5d4-1204b6fb8afe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4138ef-1298-41f4-a5b0-99ce97ffd5f5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:32 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:32 user nova-compute[74934]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 (non-flash)
Nov 19 15:07:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:32 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:32 user nova-compute[74934]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 (non-flash)
Nov 19 15:07:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc293910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[80634959-6711-4901-ad83-548eaf918933]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc053347-b4b3-45f1-8c6b-48dde1d2c71d]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e2f8a-432a-484d-9d4d-7a2877f2ebb6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.134s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d4f35a-366d-41e1-90c5-d8d0f508cc2e]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299abf3-bb15-47a0-998d-6caa2528183a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7511a0-99d7-4611-8ceb-16dacde14f61]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260]
Nov 19 15:07:32 user nova-compute[74934]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71, portal: 172.16.0.220,3260] successful.
Nov 19 15:07:32 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04c3a881-cff6-4d75-bcdc-8c979f5e3f71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b24e71-51b8-4abe-b724-1f79b3190720]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] <== disconnect_volume: return (447ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:07:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:07:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'flavor' on Instance uuid f22d32e5-e4b4-497e-bba7-affbd725831f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:07:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-41056a66-a99e-4df9-9c41-f7164bb57e45 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:36 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 is timed out.
Nov 19 15:07:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Successfully detached device vdb from instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 from the live domain config.
Nov 19 15:07:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAtJsQGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:07:36 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[456fa42a-3138-4c96-af92-0786db4e8274]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:07:36 user nova-compute[74934]: No targets found.
Nov 19 15:07:36 user nova-compute[74934]: iSNS:
Nov 19 15:07:36 user nova-compute[74934]: No targets found.
Nov 19 15:07:36 user nova-compute[74934]: STATIC:
Nov 19 15:07:36 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2
Nov 19 15:07:36 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:07:36 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:07:36 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521
Nov 19 15:07:36 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:07:36 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:07:36 user nova-compute[74934]: FIRMWARE:
Nov 19 15:07:36 user nova-compute[74934]: No targets found.
Nov 19 15:07:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:07:36 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:07:36 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6870b1-b5c7-43c9-9e3a-8cc420e00ee2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0391d2-1239-4d06-9422-c50777e53157]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:36 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 (non-flash)
Nov 19 15:07:36 user nova-compute[74934]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:07:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c44239a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c480315b-8399-4ea4-a1c6-8c9c2aa7a811]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc3940-9777-47f1-aa9a-9e8c1e622c9c]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc59cbc-92bd-4814-a7eb-f4aa81037341]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954128f-9c69-4cd5-8716-68117acf57bf]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[51da8cf6-87e3-478c-8890-373421006558]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860464e-a222-4725-9792-c089fda155cd]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260]
Nov 19 15:07:36 user nova-compute[74934]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2, portal: 172.16.0.220,3260] successful.
Nov 19 15:07:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb3bf03e-a022-4852-9201-672d3b5b20f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.067s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7c2668-aa04-4fd9-bd26-8d2105439e33]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] <== disconnect_volume: return (332ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:07:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:07:37 user nova-compute[74934]: DEBUG nova.objects.instance [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'flavor' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:07:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-553f87b8-12fa-4b18-9c20-b8c161a7fd55 tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:39 user nova-compute[74934]: INFO nova.compute.manager [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Terminating instance
Nov 19 15:07:39 user nova-compute[74934]: DEBUG nova.compute.manager [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-b945f488-c702-4480-9f1e-493b51a61388 req-e5cf50f2-ade1-4331-b1a7-8fbcfdd27791 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-vif-unplugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b945f488-c702-4480-9f1e-493b51a61388 req-e5cf50f2-ade1-4331-b1a7-8fbcfdd27791 service nova] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b945f488-c702-4480-9f1e-493b51a61388 req-e5cf50f2-ade1-4331-b1a7-8fbcfdd27791 service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b945f488-c702-4480-9f1e-493b51a61388 req-e5cf50f2-ade1-4331-b1a7-8fbcfdd27791 service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-b945f488-c702-4480-9f1e-493b51a61388 req-e5cf50f2-ade1-4331-b1a7-8fbcfdd27791 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] No waiting events found dispatching network-vif-unplugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-b945f488-c702-4480-9f1e-493b51a61388 req-e5cf50f2-ade1-4331-b1a7-8fbcfdd27791 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-vif-unplugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:40 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Instance destroyed successfully.
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lazy-loading 'resources' on Instance uuid c493f2fb-19fd-4fee-a280-9b0df1a8362c {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T14:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389079525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389079525',id=4,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T14:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0da5862e932d40a68f17b4e8bb77ef77',ramdisk_id='',reservation_id='r-e09kr0tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T14:49:59Z,user_data=None,user_id='08d75edb533b4dfca6e9785c439df050',uuid=c493f2fb-19fd-4fee-a280-9b0df1a8362c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converting VIF {"id": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "address": "fa:16:3e:ac:24:5f", "network": {"id": "9f68f6cf-804b-4c7e-a9ee-c594e1b9245f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-594162337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0da5862e932d40a68f17b4e8bb77ef77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81c9504-0f", "ovs_interfaceid": "b81c9504-0fe8-49fd-964a-dc2dcb3e9afe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG os_vif [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb81c9504-0f, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=561a872d-558d-4094-94f0-88bbc60f2b53) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:07:40 user nova-compute[74934]: INFO os_vif [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:24:5f,bridge_name='br-int',has_traffic_filtering=True,id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe,network=Network(9f68f6cf-804b-4c7e-a9ee-c594e1b9245f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81c9504-0f')
Nov 19 15:07:40 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Deleting instance files /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c_del
Nov 19 15:07:40 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Deletion of /opt/stack/data/nova/instances/c493f2fb-19fd-4fee-a280-9b0df1a8362c_del complete
Nov 19 15:07:40 user nova-compute[74934]: INFO nova.compute.manager [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 19 15:07:40 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:07:40 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:07:41 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Took 0.48 seconds to deallocate network for instance.
Nov 19 15:07:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-86131140-c66f-44c5-96d5-12c8d210a21a req-e35ecc96-ab79-4214-b6a0-ed3da24a267a service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-vif-deleted-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:41 user nova-compute[74934]: INFO nova.compute.manager [req-86131140-c66f-44c5-96d5-12c8d210a21a req-e35ecc96-ab79-4214-b6a0-ed3da24a267a service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Neutron deleted interface b81c9504-0fe8-49fd-964a-dc2dcb3e9afe; detaching it from the instance and deleting it from the info cache
Nov 19 15:07:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-86131140-c66f-44c5-96d5-12c8d210a21a req-e35ecc96-ab79-4214-b6a0-ed3da24a267a service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-86131140-c66f-44c5-96d5-12c8d210a21a req-e35ecc96-ab79-4214-b6a0-ed3da24a267a service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Detach interface failed, port_id=b81c9504-0fe8-49fd-964a-dc2dcb3e9afe, reason: Instance c493f2fb-19fd-4fee-a280-9b0df1a8362c could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:07:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:41 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Deleted allocations for instance c493f2fb-19fd-4fee-a280-9b0df1a8362c
Nov 19 15:07:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8f0ab492-9af9-4a59-b33a-7e01c5d445c6 tempest-ServerBootFromVolumeStableRescueTest-1047020547 tempest-ServerBootFromVolumeStableRescueTest-1047020547-project-member] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-5a91eeb1-bb11-4138-848e-e30ceb809f87 req-53dcab05-cdd5-4989-b1e9-2dc2120d9eb6 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received event network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:07:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5a91eeb1-bb11-4138-848e-e30ceb809f87 req-53dcab05-cdd5-4989-b1e9-2dc2120d9eb6 service nova] Acquiring lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:07:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5a91eeb1-bb11-4138-848e-e30ceb809f87 req-53dcab05-cdd5-4989-b1e9-2dc2120d9eb6 service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:07:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5a91eeb1-bb11-4138-848e-e30ceb809f87 req-53dcab05-cdd5-4989-b1e9-2dc2120d9eb6 service nova] Lock "c493f2fb-19fd-4fee-a280-9b0df1a8362c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:07:42 user nova-compute[74934]: DEBUG nova.compute.manager [req-5a91eeb1-bb11-4138-848e-e30ceb809f87 req-53dcab05-cdd5-4989-b1e9-2dc2120d9eb6 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] No waiting events found dispatching network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:07:42 user nova-compute[74934]: WARNING nova.compute.manager [req-5a91eeb1-bb11-4138-848e-e30ceb809f87 req-53dcab05-cdd5-4989-b1e9-2dc2120d9eb6 service nova] [instance: c493f2fb-19fd-4fee-a280-9b0df1a8362c] Received unexpected event network-vif-plugged-b81c9504-0fe8-49fd-964a-dc2dcb3e9afe for instance with vm_state deleted and task_state None.
Nov 19 15:07:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:07:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:07:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-changed-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Refreshing instance network info cache due to event network-changed-285f4f66-d166-45a0-b144-2c7764235d78. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] Acquiring lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] Acquired lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Refreshing network info cache for port 285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:02 user nova-compute[74934]: INFO nova.compute.manager [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Terminating instance
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-85179f3e-a425-4a31-9d36-eed7f586c93c req-8018b508-1cde-478c-a883-bd09359dc8fa service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-unplugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85179f3e-a425-4a31-9d36-eed7f586c93c req-8018b508-1cde-478c-a883-bd09359dc8fa service nova] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85179f3e-a425-4a31-9d36-eed7f586c93c req-8018b508-1cde-478c-a883-bd09359dc8fa service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85179f3e-a425-4a31-9d36-eed7f586c93c req-8018b508-1cde-478c-a883-bd09359dc8fa service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-85179f3e-a425-4a31-9d36-eed7f586c93c req-8018b508-1cde-478c-a883-bd09359dc8fa service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] No waiting events found dispatching network-vif-unplugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.compute.manager [req-85179f3e-a425-4a31-9d36-eed7f586c93c req-8018b508-1cde-478c-a883-bd09359dc8fa service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-unplugged-285f4f66-d166-45a0-b144-2c7764235d78 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updated VIF entry in instance network info cache for port 285f4f66-d166-45a0-b144-2c7764235d78. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updating instance_info_cache with network_info: [{"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-10571446-da77-462a-943d-b5196ded8edb req-a72074fd-510d-4e22-b59a-ef804f060b22 service nova] Releasing lock "refresh_cache-f22d32e5-e4b4-497e-bba7-affbd725831f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Instance destroyed successfully.
Nov 19 15:08:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'resources' on Instance uuid f22d32e5-e4b4-497e-bba7-affbd725831f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1020007602',display_name='tempest-TestStampPattern-server-1020007602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1020007602',id=40,image_ref='e80ef986-086b-4d99-888a-8cdec229309b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaznw+RT83MzYqjptBb1X4uW71wuVbCdmq+x1BcxoN6wge7Gyi94Xn4EaUTF1JIME5dMfgYbCZc4W6KVhbk5bf817if+fSPUvesBQahayNGBEygMuHSuo8LZiRqixE7vA==',key_name='tempest-TestStampPattern-449749249',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:05:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f136401348054bdaa49dc9a1f71a27b8',ramdisk_id='',reservation_id='r-yit1xxqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='edd37f42-f320-4a31-a4a0-2d0441123a61',image_min_disk='1',image_min_ram='0',image_owner_id='f136401348054bdaa49dc9a1f71a27b8',image_owner_project_name='tempest-TestStampPattern-310548474',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-310548474-project-member',image_user_id='626bafbaac4f4454a21f429798b56194',owner_project_name='tempest-TestStampPattern-310548474',owner_user_name='tempest-TestStampPattern-310548474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:05:17Z,user_data=None,user_id='626bafbaac4f4454a21f429798b56194',uuid=f22d32e5-e4b4-497e-bba7-affbd725831f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converting VIF {"id": "285f4f66-d166-45a0-b144-2c7764235d78", "address": "fa:16:3e:b5:3d:eb", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap285f4f66-d1", "ovs_interfaceid": "285f4f66-d166-45a0-b144-2c7764235d78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG os_vif [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap285f4f66-d1, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d840065-306f-451f-8e1d-e8cb5a18e2e9) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:03 user nova-compute[74934]: INFO os_vif [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:3d:eb,bridge_name='br-int',has_traffic_filtering=True,id=285f4f66-d166-45a0-b144-2c7764235d78,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap285f4f66-d1')
Nov 19 15:08:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Deleting instance files /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f_del
Nov 19 15:08:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Deletion of /opt/stack/data/nova/instances/f22d32e5-e4b4-497e-bba7-affbd725831f_del complete
Nov 19 15:08:03 user nova-compute[74934]: INFO nova.compute.manager [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 19 15:08:03 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:04 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Took 0.64 seconds to deallocate network for instance.
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Error from libvirt while getting description of instance-00000028: [Error Code 42] Domain not found: no domain with matching uuid 'f22d32e5-e4b4-497e-bba7-affbd725831f' (instance-00000028): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f22d32e5-e4b4-497e-bba7-affbd725831f' (instance-00000028)
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-918a998c-3cf1-424b-81ac-c4c28311acc9 req-9bfd68ac-395e-4732-be74-d5e84c971842 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-deleted-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:08:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8540MB free_disk=25.057151794433594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] No waiting events found dispatching network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:04 user nova-compute[74934]: WARNING nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received unexpected event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 for instance with vm_state deleted and task_state None.
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] No waiting events found dispatching network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:04 user nova-compute[74934]: WARNING nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received unexpected event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 for instance with vm_state deleted and task_state None.
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Acquiring lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] No waiting events found dispatching network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:04 user nova-compute[74934]: WARNING nova.compute.manager [req-961921a9-d41a-43ca-91d8-a723c111b122 req-cc31031e-692f-4eac-b91b-225fd413c5b3 service nova] [instance: f22d32e5-e4b4-497e-bba7-affbd725831f] Received unexpected event network-vif-plugged-285f4f66-d166-45a0-b144-2c7764235d78 for instance with vm_state deleted and task_state None.
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.025s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:04 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Deleted allocations for instance f22d32e5-e4b4-497e-bba7-affbd725831f
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance edd37f42-f320-4a31-a4a0-2d0441123a61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance da022f2a-df63-4188-879b-9c6d2530f242 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:08:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5046cc9a-487a-4ea7-89b4-24249c7185c7 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "f22d32e5-e4b4-497e-bba7-affbd725831f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:05 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:08:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:08:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:08:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:06 user nova-compute[74934]: INFO nova.compute.manager [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Terminating instance
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Skipping network cache update for instance because it is being deleted. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-47b13da4-6aa9-4880-bc4a-c82ad8f7533f req-2d6a1742-3a6a-48b0-8381-88ed7c09e99a service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-vif-unplugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47b13da4-6aa9-4880-bc4a-c82ad8f7533f req-2d6a1742-3a6a-48b0-8381-88ed7c09e99a service nova] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47b13da4-6aa9-4880-bc4a-c82ad8f7533f req-2d6a1742-3a6a-48b0-8381-88ed7c09e99a service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-47b13da4-6aa9-4880-bc4a-c82ad8f7533f req-2d6a1742-3a6a-48b0-8381-88ed7c09e99a service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-47b13da4-6aa9-4880-bc4a-c82ad8f7533f req-2d6a1742-3a6a-48b0-8381-88ed7c09e99a service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] No waiting events found dispatching network-vif-unplugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-47b13da4-6aa9-4880-bc4a-c82ad8f7533f req-2d6a1742-3a6a-48b0-8381-88ed7c09e99a service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-vif-unplugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Instance destroyed successfully.
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lazy-loading 'resources' on Instance uuid acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-189675044',display_name='tempest-TestServerVolumeAttachmentScenario-server-189675044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-189675044',id=39,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrHUK1pSo4Cesc3EZ+jST/9q6cPWtY0zkSGnFmU94I21BQlESSwbjVQbyQmaWvnAQ4c6aj5GGrd5X3DckV82idM8Qzjo4x2L5fm8rNF5sefNPIbqGqwEK+D55iQOsRyRw==',key_name='tempest-keypair-469899584',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:04:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b44750276194728a988349d75795283',ramdisk_id='',reservation_id='r-bhjzpag5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1858542823',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1858542823-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bfce44d2b84477eb863702db114a851',uuid=acbf8372-5166-49bf-8a1d-a2f0bfb59ef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Converting VIF {"id": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "address": "fa:16:3e:40:7c:1a", "network": {"id": "af0f1fbf-3d17-44c6-88bf-be3000fb41d8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1089160420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b44750276194728a988349d75795283", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf708dc-61", "ovs_interfaceid": "9cf708dc-610c-4e99-b8c9-6cb458805ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG os_vif [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cf708dc-61, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9931acde-8006-4f02-94c3-49d3a27a96cc) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:07 user nova-compute[74934]: INFO os_vif [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:7c:1a,bridge_name='br-int',has_traffic_filtering=True,id=9cf708dc-610c-4e99-b8c9-6cb458805ecd,network=Network(af0f1fbf-3d17-44c6-88bf-be3000fb41d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf708dc-61')
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Deleting instance files /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3_del
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Deletion of /opt/stack/data/nova/instances/acbf8372-5166-49bf-8a1d-a2f0bfb59ef3_del complete
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.compute.claims [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Claim successful on node user
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.compute.manager [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:08:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:08:07 user nova-compute[74934]: INFO nova.virt.block_device [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Booting with volume 0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 at /dev/vda
Nov 19 15:08:07 user nova-compute[74934]: DEBUG os_brick.utils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c629a-46fd-4dbb-a98f-93640659b4d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.policy [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4e294f1812948429c67361e43c9c425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b621639591e845318be1753ccf3a18db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9157479-7f08-42e0-8154-1633e56aed7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556e6ca-762c-4421-975f-e16fff4f6986]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[938acad9-4c4a-4259-b423-dae163fa6d16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:08:08 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e06ca-02e0-45fb-81e1-1b3adeaaacc2]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG os_brick.utils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating existing volume attachment record: abbddbae-1024-46b0-a37e-0ad0a76ec492 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:08 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Took 1.16 seconds to deallocate network for instance.
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d240298-05ea-4469-8ce6-6c325c24f253 req-1370a7b8-868b-444b-9351-7e3022515ab9 service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-vif-deleted-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:08 user nova-compute[74934]: INFO nova.compute.manager [req-3d240298-05ea-4469-8ce6-6c325c24f253 req-1370a7b8-868b-444b-9351-7e3022515ab9 service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Neutron deleted interface 9cf708dc-610c-4e99-b8c9-6cb458805ecd; detaching it from the instance and deleting it from the info cache
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.network.neutron [req-3d240298-05ea-4469-8ce6-6c325c24f253 req-1370a7b8-868b-444b-9351-7e3022515ab9 service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d240298-05ea-4469-8ce6-6c325c24f253 req-1370a7b8-868b-444b-9351-7e3022515ab9 service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Detach interface failed, port_id=9cf708dc-610c-4e99-b8c9-6cb458805ecd, reason: Instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:08 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Deleted allocations for instance acbf8372-5166-49bf-8a1d-a2f0bfb59ef3
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0f88c31a-c666-46ab-8b72-61a4e3d2c23b tempest-TestServerVolumeAttachmentScenario-1858542823 tempest-TestServerVolumeAttachmentScenario-1858542823-project-member] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.536s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-13fc4ae9-1829-4a16-a295-194b9f1df032 req-e9c59cde-c439-4f55-8622-14b9095a770c service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received event network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13fc4ae9-1829-4a16-a295-194b9f1df032 req-e9c59cde-c439-4f55-8622-14b9095a770c service nova] Acquiring lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13fc4ae9-1829-4a16-a295-194b9f1df032 req-e9c59cde-c439-4f55-8622-14b9095a770c service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13fc4ae9-1829-4a16-a295-194b9f1df032 req-e9c59cde-c439-4f55-8622-14b9095a770c service nova] Lock "acbf8372-5166-49bf-8a1d-a2f0bfb59ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-13fc4ae9-1829-4a16-a295-194b9f1df032 req-e9c59cde-c439-4f55-8622-14b9095a770c service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] No waiting events found dispatching network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:08 user nova-compute[74934]: WARNING nova.compute.manager [req-13fc4ae9-1829-4a16-a295-194b9f1df032 req-e9c59cde-c439-4f55-8622-14b9095a770c service nova] [instance: acbf8372-5166-49bf-8a1d-a2f0bfb59ef3] Received unexpected event network-vif-plugged-9cf708dc-610c-4e99-b8c9-6cb458805ecd for instance with vm_state deleted and task_state None.
Nov 19 15:08:08 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Successfully created port: bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Successfully updated port: bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquired lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-changed-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Refreshing instance network info cache due to event network-changed-bc25502d-7797-4645-9ef5-da579cc1995c. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] Acquiring lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.network.neutron [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating instance_info_cache with network_info: [{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Releasing lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance network_info: |[{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] Acquired lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:08:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Refreshing network info cache for port bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:08:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updated VIF entry in instance network info cache for port bc25502d-7797-4645-9ef5-da579cc1995c. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:08:11 user nova-compute[74934]: DEBUG nova.network.neutron [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating instance_info_cache with network_info: [{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-99cd5d89-2004-4330-9f82-c80a8ac712d3 req-8ca0c88e-78ba-4f8f-93da-b6b6bd2a5f03 service nova] Releasing lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:08:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:08:13 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Creating image(s)
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Ensure instance console log exists: /opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Start _get_guest_xml network_info=[{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': 'abbddbae-1024-46b0-a37e-0ad0a76ec492', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1cdee34-ff81-4ed0-9d71-d27c027f5b5d', 'attached_at': '', 'detached_at': '', 'volume_id': '0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'serial': '0eca6d1c-fc56-4860-9a5c-981aa1fd5a44'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:08:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:08:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:08:13 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:08:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:08:13 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:08:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:08:13 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[62534262-ac6a-40be-ab8f-13d96ee7ecb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:08:13 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[881cdf18-7de7-47da-86e9-e2119eb6fca9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44] added
Nov 19 15:08:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3664f69b-9755-45f5-9ca0-fa43ee0bb4c7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b506df-8af6-45b8-b720-2f534a29fc0d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEwRAxcm {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEwRAxcm" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa8661-0fd5-4ada-9a25-ae20ba18d8ff]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uEwRAxcm'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37bb05-6580-44de-83f4-339910f87a3a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d04249-1be8-4f2a-963b-59e96a0a0b6f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:08:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:08:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee097320-57b4-4b69-988e-f765d997e4a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]
Nov 19 15:08:14 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.
Nov 19 15:08:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83fe0c7-d0da-4bd0-8ff8-b3e4d994f8ab]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b97424-0877-4d39-85b1-9b00b184bdb5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:08:14 user nova-compute[74934]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:08:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:08:14 user nova-compute[74934]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:08:14 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca18c2-d541-414a-b3d5-00652026626b]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:08:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23631613738303965', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631613738303965', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1667574451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1667574451',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNpHBeJnBgi1FY+DNo6isZfQxgH6X3Mb5b1YCDnLJbb+D9dFMLkalhjwPgilUlVOz9Eh9EGEhMfSp/GWNhwmyYCMsXy5W9ZbxakpQ5PnbtbVL6Go7aFEcw8lHUdwnQ5+A==',key_name='tempest-keypair-1757474339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b621639591e845318be1753ccf3a18db',ramdisk_id='',reservation_id='r-o7oyqsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1088824296',owner_user_name='tempest-ServerActionsV293TestJSON-1088824296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e294f1812948429c67361e43c9c425',uuid=e1cdee34-ff81-4ed0-9d71-d27c027f5b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converting VIF {"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lazy-loading 'pci_devices' on Instance uuid e1cdee34-ff81-4ed0-9d71-d27c027f5b5d {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:08:15 user nova-compute[74934]:   <uuid>e1cdee34-ff81-4ed0-9d71-d27c027f5b5d</uuid>
Nov 19 15:08:15 user nova-compute[74934]:   <name>instance-0000002a</name>
Nov 19 15:08:15 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:08:15 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:08:15 user nova-compute[74934]:   <metadata>
Nov 19 15:08:15 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:08:15 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:08:15 user nova-compute[74934]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1667574451</nova:name>
Nov 19 15:08:15 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:08:13</nova:creationTime>
Nov 19 15:08:15 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:08:15 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:08:15 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:08:15 user nova-compute[74934]:       <nova:owner>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:user uuid="c4e294f1812948429c67361e43c9c425">tempest-ServerActionsV293TestJSON-1088824296-project-member</nova:user>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:project uuid="b621639591e845318be1753ccf3a18db">tempest-ServerActionsV293TestJSON-1088824296</nova:project>
Nov 19 15:08:15 user nova-compute[74934]:       </nova:owner>
Nov 19 15:08:15 user nova-compute[74934]:       <nova:ports>
Nov 19 15:08:15 user nova-compute[74934]:         <nova:port uuid="bc25502d-7797-4645-9ef5-da579cc1995c">
Nov 19 15:08:15 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 15:08:15 user nova-compute[74934]:         </nova:port>
Nov 19 15:08:15 user nova-compute[74934]:       </nova:ports>
Nov 19 15:08:15 user nova-compute[74934]:     </nova:instance>
Nov 19 15:08:15 user nova-compute[74934]:   </metadata>
Nov 19 15:08:15 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:08:15 user nova-compute[74934]:     <system>
Nov 19 15:08:15 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:08:15 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:08:15 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:08:15 user nova-compute[74934]:       <entry name="serial">e1cdee34-ff81-4ed0-9d71-d27c027f5b5d</entry>
Nov 19 15:08:15 user nova-compute[74934]:       <entry name="uuid">e1cdee34-ff81-4ed0-9d71-d27c027f5b5d</entry>
Nov 19 15:08:15 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:08:15 user nova-compute[74934]:     </system>
Nov 19 15:08:15 user nova-compute[74934]:   </sysinfo>
Nov 19 15:08:15 user nova-compute[74934]:   <os>
Nov 19 15:08:15 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:08:15 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:08:15 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:08:15 user nova-compute[74934]:   </os>
Nov 19 15:08:15 user nova-compute[74934]:   <features>
Nov 19 15:08:15 user nova-compute[74934]:     <acpi/>
Nov 19 15:08:15 user nova-compute[74934]:     <apic/>
Nov 19 15:08:15 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:08:15 user nova-compute[74934]:   </features>
Nov 19 15:08:15 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:08:15 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:08:15 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:08:15 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:08:15 user nova-compute[74934]:   </clock>
Nov 19 15:08:15 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:08:15 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:08:15 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:08:15 user nova-compute[74934]:   </cpu>
Nov 19 15:08:15 user nova-compute[74934]:   <devices>
Nov 19 15:08:15 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:08:15 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:08:15 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 15:08:15 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:08:15 user nova-compute[74934]:       <serial>0eca6d1c-fc56-4860-9a5c-981aa1fd5a44</serial>
Nov 19 15:08:15 user nova-compute[74934]:     </disk>
Nov 19 15:08:15 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:08:15 user nova-compute[74934]:       <mac address="fa:16:3e:60:f6:b4"/>
Nov 19 15:08:15 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:08:15 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:08:15 user nova-compute[74934]:       <target dev="tapbc25502d-77"/>
Nov 19 15:08:15 user nova-compute[74934]:     </interface>
Nov 19 15:08:15 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:08:15 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d/console.log" append="off"/>
Nov 19 15:08:15 user nova-compute[74934]:     </serial>
Nov 19 15:08:15 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:08:15 user nova-compute[74934]:     <video>
Nov 19 15:08:15 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:08:15 user nova-compute[74934]:     </video>
Nov 19 15:08:15 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:08:15 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:08:15 user nova-compute[74934]:     </rng>
Nov 19 15:08:15 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:08:15 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:08:15 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:08:15 user nova-compute[74934]:     </memballoon>
Nov 19 15:08:15 user nova-compute[74934]:   </devices>
Nov 19 15:08:15 user nova-compute[74934]: </domain>
Nov 19 15:08:15 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1667574451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1667574451',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNpHBeJnBgi1FY+DNo6isZfQxgH6X3Mb5b1YCDnLJbb+D9dFMLkalhjwPgilUlVOz9Eh9EGEhMfSp/GWNhwmyYCMsXy5W9ZbxakpQ5PnbtbVL6Go7aFEcw8lHUdwnQ5+A==',key_name='tempest-keypair-1757474339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b621639591e845318be1753ccf3a18db',ramdisk_id='',reservation_id='r-o7oyqsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1088824296',owner_user_name='tempest-ServerActionsV293TestJSON-1088824296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e294f1812948429c67361e43c9c425',uuid=e1cdee34-ff81-4ed0-9d71-d27c027f5b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converting VIF {"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG os_vif [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af0218fc-fb7b-5766-a514-e60ae0389028', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc25502d-77, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc25502d-77, col_values=(('qos', UUID('68e2a20f-9694-4861-bfdd-bee53f079885')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc25502d-77, col_values=(('external_ids', {'iface-id': 'bc25502d-7797-4645-9ef5-da579cc1995c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:f6:b4', 'vm-uuid': 'e1cdee34-ff81-4ed0-9d71-d27c027f5b5d'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:15 user nova-compute[74934]: INFO os_vif [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77')
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] No VIF found with MAC fa:16:3e:60:f6:b4, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:08:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:08:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-d57bc06a-f0f7-4a7e-acfc-0739b33a143e req-ce9f959e-5faa-4451-bd8f-cba37f7e7005 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d57bc06a-f0f7-4a7e-acfc-0739b33a143e req-ce9f959e-5faa-4451-bd8f-cba37f7e7005 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d57bc06a-f0f7-4a7e-acfc-0739b33a143e req-ce9f959e-5faa-4451-bd8f-cba37f7e7005 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d57bc06a-f0f7-4a7e-acfc-0739b33a143e req-ce9f959e-5faa-4451-bd8f-cba37f7e7005 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-d57bc06a-f0f7-4a7e-acfc-0739b33a143e req-ce9f959e-5faa-4451-bd8f-cba37f7e7005 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:17 user nova-compute[74934]: WARNING nova.compute.manager [req-d57bc06a-f0f7-4a7e-acfc-0739b33a143e req-ce9f959e-5faa-4451-bd8f-cba37f7e7005 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state building and task_state spawning.
Nov 19 15:08:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "0fb57f37-ba3d-4829-ba1b-468691944b1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:08:17 user nova-compute[74934]: INFO nova.compute.claims [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Claim successful on node user
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:08:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.policy [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7da57023d23a4927b07cd1c7411dd497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba13b6c4e1f4c9a8835613370a02f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:08:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Creating image(s)
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "/opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "/opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk 1073741824" returned: 0 in 0.056s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Successfully created port: 8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:08:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance spawned successfully.
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.213s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:08:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-dfe39cb4-9445-4f43-99ad-d46d0a262365 req-c13af780-5df5-4e5e-87f6-ade80a58f6f8 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dfe39cb4-9445-4f43-99ad-d46d0a262365 req-c13af780-5df5-4e5e-87f6-ade80a58f6f8 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dfe39cb4-9445-4f43-99ad-d46d0a262365 req-c13af780-5df5-4e5e-87f6-ade80a58f6f8 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dfe39cb4-9445-4f43-99ad-d46d0a262365 req-c13af780-5df5-4e5e-87f6-ade80a58f6f8 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-dfe39cb4-9445-4f43-99ad-d46d0a262365 req-c13af780-5df5-4e5e-87f6-ade80a58f6f8 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:19 user nova-compute[74934]: WARNING nova.compute.manager [req-dfe39cb4-9445-4f43-99ad-d46d0a262365 req-c13af780-5df5-4e5e-87f6-ade80a58f6f8 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state building and task_state spawning.
Nov 19 15:08:19 user nova-compute[74934]: INFO nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Cannot resize image /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:19 user nova-compute[74934]: INFO nova.compute.manager [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Took 12.20 seconds to build instance.
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6824edb-9283-43bd-9b35-7fa6c024ea15 tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.311s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Successfully updated port: 8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquired lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Received event network-changed-8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Refreshing instance network info cache due to event network-changed-8b4ada76-7da4-4a35-99a0-9c170f25a02a. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] Acquiring lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Updating instance_info_cache with network_info: [{"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Releasing lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Instance network_info: |[{"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] Acquired lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Refreshing network info cache for port 8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Start _get_guest_xml network_info=[{"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:08:19 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:08:19 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1430775944',display_name='tempest-VolumesActionsTest-instance-1430775944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1430775944',id=43,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ba13b6c4e1f4c9a8835613370a02f28',ramdisk_id='',reservation_id='r-mweayz0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1407456652',owner_user_name='tempest-VolumesActionsTest-1407456652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:08:18Z,user_data=None,user_id='7da57023d23a4927b07cd1c7411dd497',uuid=0fb57f37-ba3d-4829-ba1b-468691944b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Converting VIF {"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb57f37-ba3d-4829-ba1b-468691944b1f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:08:19 user nova-compute[74934]:   <uuid>0fb57f37-ba3d-4829-ba1b-468691944b1f</uuid>
Nov 19 15:08:19 user nova-compute[74934]:   <name>instance-0000002b</name>
Nov 19 15:08:19 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:08:19 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:08:19 user nova-compute[74934]:   <metadata>
Nov 19 15:08:19 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:08:19 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:08:19 user nova-compute[74934]:       <nova:name>tempest-VolumesActionsTest-instance-1430775944</nova:name>
Nov 19 15:08:19 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:08:19</nova:creationTime>
Nov 19 15:08:19 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:08:19 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:08:19 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:08:19 user nova-compute[74934]:       <nova:owner>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:user uuid="7da57023d23a4927b07cd1c7411dd497">tempest-VolumesActionsTest-1407456652-project-member</nova:user>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:project uuid="9ba13b6c4e1f4c9a8835613370a02f28">tempest-VolumesActionsTest-1407456652</nova:project>
Nov 19 15:08:19 user nova-compute[74934]:       </nova:owner>
Nov 19 15:08:19 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:08:19 user nova-compute[74934]:       <nova:ports>
Nov 19 15:08:19 user nova-compute[74934]:         <nova:port uuid="8b4ada76-7da4-4a35-99a0-9c170f25a02a">
Nov 19 15:08:19 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 19 15:08:19 user nova-compute[74934]:         </nova:port>
Nov 19 15:08:19 user nova-compute[74934]:       </nova:ports>
Nov 19 15:08:19 user nova-compute[74934]:     </nova:instance>
Nov 19 15:08:19 user nova-compute[74934]:   </metadata>
Nov 19 15:08:19 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:08:19 user nova-compute[74934]:     <system>
Nov 19 15:08:19 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:08:19 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:08:19 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:08:19 user nova-compute[74934]:       <entry name="serial">0fb57f37-ba3d-4829-ba1b-468691944b1f</entry>
Nov 19 15:08:19 user nova-compute[74934]:       <entry name="uuid">0fb57f37-ba3d-4829-ba1b-468691944b1f</entry>
Nov 19 15:08:19 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:08:19 user nova-compute[74934]:     </system>
Nov 19 15:08:19 user nova-compute[74934]:   </sysinfo>
Nov 19 15:08:19 user nova-compute[74934]:   <os>
Nov 19 15:08:19 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:08:19 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:08:19 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:08:19 user nova-compute[74934]:   </os>
Nov 19 15:08:19 user nova-compute[74934]:   <features>
Nov 19 15:08:19 user nova-compute[74934]:     <acpi/>
Nov 19 15:08:19 user nova-compute[74934]:     <apic/>
Nov 19 15:08:19 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:08:19 user nova-compute[74934]:   </features>
Nov 19 15:08:19 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:08:19 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:08:19 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:08:19 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:08:19 user nova-compute[74934]:   </clock>
Nov 19 15:08:19 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:08:19 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:08:19 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:08:19 user nova-compute[74934]:   </cpu>
Nov 19 15:08:19 user nova-compute[74934]:   <devices>
Nov 19 15:08:19 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:08:19 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:08:19 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk"/>
Nov 19 15:08:19 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:08:19 user nova-compute[74934]:     </disk>
Nov 19 15:08:19 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:08:19 user nova-compute[74934]:       <mac address="fa:16:3e:13:b2:ec"/>
Nov 19 15:08:19 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:08:19 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:08:19 user nova-compute[74934]:       <target dev="tap8b4ada76-7d"/>
Nov 19 15:08:19 user nova-compute[74934]:     </interface>
Nov 19 15:08:19 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:08:19 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/console.log" append="off"/>
Nov 19 15:08:19 user nova-compute[74934]:     </serial>
Nov 19 15:08:19 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:08:19 user nova-compute[74934]:     <video>
Nov 19 15:08:19 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:08:19 user nova-compute[74934]:     </video>
Nov 19 15:08:19 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:08:19 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:08:19 user nova-compute[74934]:     </rng>
Nov 19 15:08:19 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:08:19 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:08:19 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:08:19 user nova-compute[74934]:     </memballoon>
Nov 19 15:08:19 user nova-compute[74934]:   </devices>
Nov 19 15:08:19 user nova-compute[74934]: </domain>
Nov 19 15:08:19 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1430775944',display_name='tempest-VolumesActionsTest-instance-1430775944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1430775944',id=43,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ba13b6c4e1f4c9a8835613370a02f28',ramdisk_id='',reservation_id='r-mweayz0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1407456652',owner_user_name='tempest-VolumesActionsTest-1407456652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:08:18Z,user_data=None,user_id='7da57023d23a4927b07cd1c7411dd497',uuid=0fb57f37-ba3d-4829-ba1b-468691944b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Converting VIF {"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG os_vif [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43e456ee-365b-5864-ac80-ea290d53c6d8', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4ada76-7d, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b4ada76-7d, col_values=(('qos', UUID('05ba71f8-fd45-40ba-8350-adb89b954ce0')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b4ada76-7d, col_values=(('external_ids', {'iface-id': '8b4ada76-7da4-4a35-99a0-9c170f25a02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b2:ec', 'vm-uuid': '0fb57f37-ba3d-4829-ba1b-468691944b1f'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:19 user nova-compute[74934]: INFO os_vif [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d')
Nov 19 15:08:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:08:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] No VIF found with MAC fa:16:3e:13:b2:ec, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:08:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Updated VIF entry in instance network info cache for port 8b4ada76-7da4-4a35-99a0-9c170f25a02a. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:08:20 user nova-compute[74934]: DEBUG nova.network.neutron [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Updating instance_info_cache with network_info: [{"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3852471a-b90a-4bb6-bf3b-2e3f3238debe req-0898b0a1-9df2-4aaa-bcde-9fcfbcfad313 service nova] Releasing lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:08:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-773d4725-a1ed-4b94-8b55-c9d3ce25ad3c req-4b2f8276-6b3e-424d-95f4-5f414a8824c3 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Received event network-vif-plugged-8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-773d4725-a1ed-4b94-8b55-c9d3ce25ad3c req-4b2f8276-6b3e-424d-95f4-5f414a8824c3 service nova] Acquiring lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-773d4725-a1ed-4b94-8b55-c9d3ce25ad3c req-4b2f8276-6b3e-424d-95f4-5f414a8824c3 service nova] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-773d4725-a1ed-4b94-8b55-c9d3ce25ad3c req-4b2f8276-6b3e-424d-95f4-5f414a8824c3 service nova] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-773d4725-a1ed-4b94-8b55-c9d3ce25ad3c req-4b2f8276-6b3e-424d-95f4-5f414a8824c3 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] No waiting events found dispatching network-vif-plugged-8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:21 user nova-compute[74934]: WARNING nova.compute.manager [req-773d4725-a1ed-4b94-8b55-c9d3ce25ad3c req-4b2f8276-6b3e-424d-95f4-5f414a8824c3 service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Received unexpected event network-vif-plugged-8b4ada76-7da4-4a35-99a0-9c170f25a02a for instance with vm_state building and task_state spawning.
Nov 19 15:08:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e56568f-b9c1-4e12-be6f-420280102314 req-2aa77621-0d11-460c-b399-d3df2c1a138e service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Received event network-vif-plugged-8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e56568f-b9c1-4e12-be6f-420280102314 req-2aa77621-0d11-460c-b399-d3df2c1a138e service nova] Acquiring lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e56568f-b9c1-4e12-be6f-420280102314 req-2aa77621-0d11-460c-b399-d3df2c1a138e service nova] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2e56568f-b9c1-4e12-be6f-420280102314 req-2aa77621-0d11-460c-b399-d3df2c1a138e service nova] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.compute.manager [req-2e56568f-b9c1-4e12-be6f-420280102314 req-2aa77621-0d11-460c-b399-d3df2c1a138e service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] No waiting events found dispatching network-vif-plugged-8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:23 user nova-compute[74934]: WARNING nova.compute.manager [req-2e56568f-b9c1-4e12-be6f-420280102314 req-2aa77621-0d11-460c-b399-d3df2c1a138e service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Received unexpected event network-vif-plugged-8b4ada76-7da4-4a35-99a0-9c170f25a02a for instance with vm_state building and task_state spawning.
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:08:23 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Instance spawned successfully.
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:08:23 user nova-compute[74934]: INFO nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 19 15:08:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:08:23 user nova-compute[74934]: INFO nova.compute.manager [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Took 6.06 seconds to build instance.
Nov 19 15:08:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6d40cd86-c54d-43b4-a269-530c51b80757 tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.166s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "da022f2a-df63-4188-879b-9c6d2530f242" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:35 user nova-compute[74934]: INFO nova.compute.manager [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Terminating instance
Nov 19 15:08:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-f754fdab-a830-409d-b648-3609c611e638 req-fbc2436f-8c5f-45ef-88fa-26851fbc8c9b service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-vif-unplugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f754fdab-a830-409d-b648-3609c611e638 req-fbc2436f-8c5f-45ef-88fa-26851fbc8c9b service nova] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f754fdab-a830-409d-b648-3609c611e638 req-fbc2436f-8c5f-45ef-88fa-26851fbc8c9b service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f754fdab-a830-409d-b648-3609c611e638 req-fbc2436f-8c5f-45ef-88fa-26851fbc8c9b service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-f754fdab-a830-409d-b648-3609c611e638 req-fbc2436f-8c5f-45ef-88fa-26851fbc8c9b service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] No waiting events found dispatching network-vif-unplugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-f754fdab-a830-409d-b648-3609c611e638 req-fbc2436f-8c5f-45ef-88fa-26851fbc8c9b service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-vif-unplugged-6d337acc-92cb-4064-99cd-205a310116e7 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:08:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Instance destroyed successfully.
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'resources' on Instance uuid da022f2a-df63-4188-879b-9c6d2530f242 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013825291',display_name='tempest-TestVolumeBootPattern-server-2013825291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013825291',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:07:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-fyf04ydx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:07:02Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=da022f2a-df63-4188-879b-9c6d2530f242,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "6d337acc-92cb-4064-99cd-205a310116e7", "address": "fa:16:3e:72:42:82", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d337acc-92", "ovs_interfaceid": "6d337acc-92cb-4064-99cd-205a310116e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_vif [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d337acc-92, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e6d447d-d8d9-415a-9479-706f6863b3c1) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:08:36 user nova-compute[74934]: INFO os_vif [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:42:82,bridge_name='br-int',has_traffic_filtering=True,id=6d337acc-92cb-4064-99cd-205a310116e7,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d337acc-92')
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EpSPJtDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:08:36 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[336bd358-9bf1-4663-9813-50a961c8cc70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:08:36 user nova-compute[74934]: No targets found.
Nov 19 15:08:36 user nova-compute[74934]: iSNS:
Nov 19 15:08:36 user nova-compute[74934]: No targets found.
Nov 19 15:08:36 user nova-compute[74934]: STATIC:
Nov 19 15:08:36 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44
Nov 19 15:08:36 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:08:36 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:08:36 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521
Nov 19 15:08:36 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:08:36 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:08:36 user nova-compute[74934]: FIRMWARE:
Nov 19 15:08:36 user nova-compute[74934]: No targets found.
Nov 19 15:08:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:08:36 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:08:36 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21c1a8-b2d2-492e-9803-adb07542e00b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b55ec67-b582-4258-bcb3-7b56e18dde50]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:08:36 user nova-compute[74934]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:08:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 (non-flash)
Nov 19 15:08:36 user nova-compute[74934]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:08:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4243520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e41a91-eb41-4c31-b77f-e74887924427]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f48739-4a04-45c7-a9a2-ac5aaab37fa5]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9908b71e-7a31-4b98-9a08-4f6835ad28b9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[93882469-cb8b-4142-adac-4fa83581853b]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bc1837b8', '/dev/disk/by-id/scsi-1SCST_BIObc1837b8-b42e3665dbb851b7', '/dev/disk/by-id/scsi-26234326533363635') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa3de6d-935a-45e2-9389-44237dd4d4b8]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[538d4f06-405e-4599-83ca-bd50b270a1d3]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f17a0-d883-4c83-89c7-f61f48334c95]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260]
Nov 19 15:08:36 user nova-compute[74934]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521, portal: 172.16.0.220,3260] successful.
Nov 19 15:08:36 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2786f45d-2b0c-46d5-8ee4-f20211fe4521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f0f9e0-10a8-4f53-8cb4-c7bed81d2b5c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== disconnect_volume: return (324ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:08:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Deleting instance files /opt/stack/data/nova/instances/da022f2a-df63-4188-879b-9c6d2530f242_del
Nov 19 15:08:36 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Deletion of /opt/stack/data/nova/instances/da022f2a-df63-4188-879b-9c6d2530f242_del complete
Nov 19 15:08:36 user nova-compute[74934]: INFO nova.compute.manager [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 19 15:08:36 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:08:36 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: da022f2a-df63-4188-879b-9c6d2530f242] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:08:37 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:08:37 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Took 0.55 seconds to deallocate network for instance.
Nov 19 15:08:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-6c9714f4-5e6d-4281-87a2-c04aaf8eb057 req-8eb4b3dc-86cc-4692-9a78-64be1329789c service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-vif-deleted-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-8ae5be3c-c91d-4557-8628-e51023d2456f req-bfeef912-3e92-4305-8521-7f4e2178a4f8 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received event network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8ae5be3c-c91d-4557-8628-e51023d2456f req-bfeef912-3e92-4305-8521-7f4e2178a4f8 service nova] Acquiring lock "da022f2a-df63-4188-879b-9c6d2530f242-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8ae5be3c-c91d-4557-8628-e51023d2456f req-bfeef912-3e92-4305-8521-7f4e2178a4f8 service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8ae5be3c-c91d-4557-8628-e51023d2456f req-bfeef912-3e92-4305-8521-7f4e2178a4f8 service nova] Lock "da022f2a-df63-4188-879b-9c6d2530f242-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-8ae5be3c-c91d-4557-8628-e51023d2456f req-bfeef912-3e92-4305-8521-7f4e2178a4f8 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] No waiting events found dispatching network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:08:38 user nova-compute[74934]: WARNING nova.compute.manager [req-8ae5be3c-c91d-4557-8628-e51023d2456f req-bfeef912-3e92-4305-8521-7f4e2178a4f8 service nova] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Received unexpected event network-vif-plugged-6d337acc-92cb-4064-99cd-205a310116e7 for instance with vm_state active and task_state deleting.
Nov 19 15:08:38 user nova-compute[74934]: INFO nova.compute.manager [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Took 0.81 seconds to detach 1 volumes for instance.
Nov 19 15:08:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: da022f2a-df63-4188-879b-9c6d2530f242] Deleting volume: 2786f45d-2b0c-46d5-8ee4-f20211fe4521 {{(pid=74934) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:38 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Deleted allocations for instance da022f2a-df63-4188-879b-9c6d2530f242
Nov 19 15:08:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f5e42631-935f-4f8b-96db-8ef5b101d662 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "da022f2a-df63-4188-879b-9c6d2530f242" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.265s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:08:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:08:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:00 user nova-compute[74934]: INFO nova.compute.manager [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Terminating instance
Nov 19 15:09:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-changed-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG nova.compute.manager [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Refreshing instance network info cache due to event network-changed-09874d1f-26ee-47a8-962d-3aeba7286674. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] Acquiring lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] Acquired lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG nova.network.neutron [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Refreshing network info cache for port 09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-f9ece1c9-402d-4fac-b7af-0d0107de65fb req-0d9e6b13-5854-45e0-8a2f-cdc4781e0043 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-unplugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f9ece1c9-402d-4fac-b7af-0d0107de65fb req-0d9e6b13-5854-45e0-8a2f-cdc4781e0043 service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f9ece1c9-402d-4fac-b7af-0d0107de65fb req-0d9e6b13-5854-45e0-8a2f-cdc4781e0043 service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f9ece1c9-402d-4fac-b7af-0d0107de65fb req-0d9e6b13-5854-45e0-8a2f-cdc4781e0043 service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-f9ece1c9-402d-4fac-b7af-0d0107de65fb req-0d9e6b13-5854-45e0-8a2f-cdc4781e0043 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-unplugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-f9ece1c9-402d-4fac-b7af-0d0107de65fb req-0d9e6b13-5854-45e0-8a2f-cdc4781e0043 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-unplugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updated VIF entry in instance network info cache for port 09874d1f-26ee-47a8-962d-3aeba7286674. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating instance_info_cache with network_info: [{"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7bc00a9d-587b-4747-801d-70e0604074c7 req-7b5f8c76-c59e-44f9-af83-e3046ca49925 service nova] Releasing lock "refresh_cache-edd37f42-f320-4a31-a4a0-2d0441123a61" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Instance destroyed successfully.
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lazy-loading 'resources' on Instance uuid edd37f42-f320-4a31-a4a0-2d0441123a61 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:01:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316930228',display_name='tempest-TestStampPattern-server-1316930228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1316930228',id=36,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaznw+RT83MzYqjptBb1X4uW71wuVbCdmq+x1BcxoN6wge7Gyi94Xn4EaUTF1JIME5dMfgYbCZc4W6KVhbk5bf817if+fSPUvesBQahayNGBEygMuHSuo8LZiRqixE7vA==',key_name='tempest-TestStampPattern-449749249',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:02:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f136401348054bdaa49dc9a1f71a27b8',ramdisk_id='',reservation_id='r-vkvd13tm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-310548474',owner_user_name='tempest-TestStampPattern-310548474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:05:07Z,user_data=None,user_id='626bafbaac4f4454a21f429798b56194',uuid=edd37f42-f320-4a31-a4a0-2d0441123a61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converting VIF {"id": "09874d1f-26ee-47a8-962d-3aeba7286674", "address": "fa:16:3e:48:c4:03", "network": {"id": "8704c654-6078-4834-873b-bbc9422b6307", "bridge": "br-int", "label": "tempest-TestStampPattern-1460255758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f136401348054bdaa49dc9a1f71a27b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09874d1f-26", "ovs_interfaceid": "09874d1f-26ee-47a8-962d-3aeba7286674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG os_vif [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09874d1f-26, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e066fbd-175f-451b-b7b0-98d0132b2155) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:01 user nova-compute[74934]: INFO os_vif [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:c4:03,bridge_name='br-int',has_traffic_filtering=True,id=09874d1f-26ee-47a8-962d-3aeba7286674,network=Network(8704c654-6078-4834-873b-bbc9422b6307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09874d1f-26')
Nov 19 15:09:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Deleting instance files /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61_del
Nov 19 15:09:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Deletion of /opt/stack/data/nova/instances/edd37f42-f320-4a31-a4a0-2d0441123a61_del complete
Nov 19 15:09:01 user nova-compute[74934]: INFO nova.compute.manager [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 19 15:09:01 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:09:01 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:09:02 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Took 0.77 seconds to deallocate network for instance.
Nov 19 15:09:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:09:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:02 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Deleted allocations for instance edd37f42-f320-4a31-a4a0-2d0441123a61
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f39cf159-7113-4394-ae34-923b0f67fa50 tempest-TestStampPattern-310548474 tempest-TestStampPattern-310548474-project-member] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:03 user nova-compute[74934]: WARNING nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received unexpected event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with vm_state deleted and task_state None.
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:03 user nova-compute[74934]: WARNING nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received unexpected event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with vm_state deleted and task_state None.
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:03 user nova-compute[74934]: WARNING nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received unexpected event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with vm_state deleted and task_state None.
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Acquiring lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] Lock "edd37f42-f320-4a31-a4a0-2d0441123a61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] No waiting events found dispatching network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:03 user nova-compute[74934]: WARNING nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received unexpected event network-vif-plugged-09874d1f-26ee-47a8-962d-3aeba7286674 for instance with vm_state deleted and task_state None.
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-c18c54d1-eed2-4803-b1d0-5c7f4c1f02b6 req-cd107041-cc10-4b73-8bc6-9270fc42071d service nova] [instance: edd37f42-f320-4a31-a4a0-2d0441123a61] Received event network-vif-deleted-09874d1f-26ee-47a8-962d-3aeba7286674 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:03 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:09:04 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=25.168399810791016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e1cdee34-ff81-4ed0-9d71-d27c027f5b5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0fb57f37-ba3d-4829-ba1b-468691944b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:09:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:09:06 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid e1cdee34-ff81-4ed0-9d71-d27c027f5b5d {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:09:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating instance_info_cache with network_info: [{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:09:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:09:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:09:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:09:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:09:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:09:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:09:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:09:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:09:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:09:38 user nova-compute[74934]: INFO nova.compute.claims [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Claim successful on node user
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:09:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:09:39 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG nova.policy [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ade11c889684ca9b402fa1066e4b629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441622bd90c1460fb78ac8ebdbead719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:09:39 user nova-compute[74934]: INFO nova.virt.block_device [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Booting with volume 815b1e9a-3380-490e-85ee-f20871af21b1 at /dev/vda
Nov 19 15:09:39 user nova-compute[74934]: DEBUG os_brick.utils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2353b5-0527-4439-8c99-9465f6f61559]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d93e9d-7c87-4a91-afe8-5496a7894e90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0e0580-7095-42e0-9d10-bcaf85bcfe73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad3d7c-2413-4867-a391-19af0cad733c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:09:39 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:09:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc4d33-6e05-4daf-8d1c-784cddeb39e4]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG os_brick.utils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating existing volume attachment record: 975db246-4b4e-40d4-a80a-1079c7b3afb6 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:09:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Successfully created port: 58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Successfully updated port: 58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquired lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-changed-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG nova.compute.manager [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Refreshing instance network info cache due to event network-changed-58fd1e88-8d8a-42cf-9b6f-2580461947e1. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] Acquiring lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:09:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG nova.network.neutron [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating instance_info_cache with network_info: [{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Releasing lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Instance network_info: |[{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] Acquired lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Refreshing network info cache for port 58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updated VIF entry in instance network info cache for port 58fd1e88-8d8a-42cf-9b6f-2580461947e1. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG nova.network.neutron [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating instance_info_cache with network_info: [{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dbaa4a51-7005-4176-95f0-841c7922d479 req-0a3bc5c6-bfe7-47f0-80d5-123d14669734 service nova] Releasing lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:09:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:09:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:09:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:09:47 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Creating image(s)
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Ensure instance console log exists: /opt/stack/data/nova/instances/dedb3c16-b4a4-4533-b0de-97f218d229ea/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Start _get_guest_xml network_info=[{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '975db246-4b4e-40d4-a80a-1079c7b3afb6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diEjrNuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dedb3c16-b4a4-4533-b0de-97f218d229ea', 'attached_at': '', 'detached_at': '', 'volume_id': '815b1e9a-3380-490e-85ee-f20871af21b1', 'serial': '815b1e9a-3380-490e-85ee-f20871af21b1'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:09:47 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:09:47 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diEjrNuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:09:47 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:09:47 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:09:47 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a387527-71ae-4d6d-b74c-e0a9e8867e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:09:47 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[72464e43-a8f7-44f0-8557-1cb1559abde3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1] added
Nov 19 15:09:47 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[71797324-6f07-4939-a76c-ca1c9a2accc6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac027129-deab-43b3-b2d1-1de2c0a7e68e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v diEjrNuw {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v diEjrNuw" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f450bb8-5ff5-46b2-bff4-9a5732067f81]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'diEjrNuw'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce04cff-9be5-4a70-9464-85eece2e6471]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b8d719-3a47-4003-bb73-3fc37f08de5d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:09:47 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:09:47 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be511e6-2e1d-4432-b6b8-8b658c834970]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260]
Nov 19 15:09:47 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260] successful.
Nov 19 15:09:47 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baae190-f006-486e-81c4-0916c41679b7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce35ba-7c53-47ec-a87f-e6febc957c2f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:09:47 user nova-compute[74934]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:09:47 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:09:47 user nova-compute[74934]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:09:47 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8615410-0583-47be-9b04-d6714979bce9]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:09:47 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diEjrNuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23631383937623134', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631383937623134', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1621285312',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1621285312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1621285312',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVyvXjdFnqP+x8/UFOsL/nPs93MwOdbg3hsEp/Syl10xzD4wMCgPFmtF12kf82y+6e4z+lK3DdSCfD/525/Qsathjg4SUi2NJ6dSPl/LJNAvZRi8utCRbMNiQKzDwLCIw==',key_name='tempest-keypair-573577072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-vy63qo6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ade11c889684ca9b402fa1066e4b629',uuid=dedb3c16-b4a4-4533-b0de-97f218d229ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'pci_devices' on Instance uuid dedb3c16-b4a4-4533-b0de-97f218d229ea {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:09:48 user nova-compute[74934]:   <uuid>dedb3c16-b4a4-4533-b0de-97f218d229ea</uuid>
Nov 19 15:09:48 user nova-compute[74934]:   <name>instance-0000002c</name>
Nov 19 15:09:48 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:09:48 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:09:48 user nova-compute[74934]:   <metadata>
Nov 19 15:09:48 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:09:48 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:09:48 user nova-compute[74934]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1621285312</nova:name>
Nov 19 15:09:48 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:09:47</nova:creationTime>
Nov 19 15:09:48 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:09:48 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:09:48 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:09:48 user nova-compute[74934]:       <nova:owner>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:user uuid="3ade11c889684ca9b402fa1066e4b629">tempest-TestVolumeBootPattern-686579107-project-member</nova:user>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:project uuid="441622bd90c1460fb78ac8ebdbead719">tempest-TestVolumeBootPattern-686579107</nova:project>
Nov 19 15:09:48 user nova-compute[74934]:       </nova:owner>
Nov 19 15:09:48 user nova-compute[74934]:       <nova:ports>
Nov 19 15:09:48 user nova-compute[74934]:         <nova:port uuid="58fd1e88-8d8a-42cf-9b6f-2580461947e1">
Nov 19 15:09:48 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 15:09:48 user nova-compute[74934]:         </nova:port>
Nov 19 15:09:48 user nova-compute[74934]:       </nova:ports>
Nov 19 15:09:48 user nova-compute[74934]:     </nova:instance>
Nov 19 15:09:48 user nova-compute[74934]:   </metadata>
Nov 19 15:09:48 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:09:48 user nova-compute[74934]:     <system>
Nov 19 15:09:48 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:09:48 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:09:48 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:09:48 user nova-compute[74934]:       <entry name="serial">dedb3c16-b4a4-4533-b0de-97f218d229ea</entry>
Nov 19 15:09:48 user nova-compute[74934]:       <entry name="uuid">dedb3c16-b4a4-4533-b0de-97f218d229ea</entry>
Nov 19 15:09:48 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:09:48 user nova-compute[74934]:     </system>
Nov 19 15:09:48 user nova-compute[74934]:   </sysinfo>
Nov 19 15:09:48 user nova-compute[74934]:   <os>
Nov 19 15:09:48 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:09:48 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:09:48 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:09:48 user nova-compute[74934]:   </os>
Nov 19 15:09:48 user nova-compute[74934]:   <features>
Nov 19 15:09:48 user nova-compute[74934]:     <acpi/>
Nov 19 15:09:48 user nova-compute[74934]:     <apic/>
Nov 19 15:09:48 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:09:48 user nova-compute[74934]:   </features>
Nov 19 15:09:48 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:09:48 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:09:48 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:09:48 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:09:48 user nova-compute[74934]:   </clock>
Nov 19 15:09:48 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:09:48 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:09:48 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:09:48 user nova-compute[74934]:   </cpu>
Nov 19 15:09:48 user nova-compute[74934]:   <devices>
Nov 19 15:09:48 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:09:48 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:09:48 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 15:09:48 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:09:48 user nova-compute[74934]:       <serial>815b1e9a-3380-490e-85ee-f20871af21b1</serial>
Nov 19 15:09:48 user nova-compute[74934]:     </disk>
Nov 19 15:09:48 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:09:48 user nova-compute[74934]:       <mac address="fa:16:3e:dd:d7:c8"/>
Nov 19 15:09:48 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:09:48 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:09:48 user nova-compute[74934]:       <target dev="tap58fd1e88-8d"/>
Nov 19 15:09:48 user nova-compute[74934]:     </interface>
Nov 19 15:09:48 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:09:48 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/dedb3c16-b4a4-4533-b0de-97f218d229ea/console.log" append="off"/>
Nov 19 15:09:48 user nova-compute[74934]:     </serial>
Nov 19 15:09:48 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:09:48 user nova-compute[74934]:     <video>
Nov 19 15:09:48 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:09:48 user nova-compute[74934]:     </video>
Nov 19 15:09:48 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:09:48 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:09:48 user nova-compute[74934]:     </rng>
Nov 19 15:09:48 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:09:48 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:09:48 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:09:48 user nova-compute[74934]:     </memballoon>
Nov 19 15:09:48 user nova-compute[74934]:   </devices>
Nov 19 15:09:48 user nova-compute[74934]: </domain>
Nov 19 15:09:48 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1621285312',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1621285312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1621285312',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVyvXjdFnqP+x8/UFOsL/nPs93MwOdbg3hsEp/Syl10xzD4wMCgPFmtF12kf82y+6e4z+lK3DdSCfD/525/Qsathjg4SUi2NJ6dSPl/LJNAvZRi8utCRbMNiQKzDwLCIw==',key_name='tempest-keypair-573577072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-vy63qo6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ade11c889684ca9b402fa1066e4b629',uuid=dedb3c16-b4a4-4533-b0de-97f218d229ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG os_vif [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35b016d0-99be-5724-892f-c5909cb9353d', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58fd1e88-8d, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58fd1e88-8d, col_values=(('qos', UUID('492b9f74-17e6-4313-b4a7-1d416f3cd199')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58fd1e88-8d, col_values=(('external_ids', {'iface-id': '58fd1e88-8d8a-42cf-9b6f-2580461947e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:d7:c8', 'vm-uuid': 'dedb3c16-b4a4-4533-b0de-97f218d229ea'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:48 user nova-compute[74934]: INFO os_vif [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d')
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:09:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No VIF found with MAC fa:16:3e:dd:d7:c8, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-8823fc96-374b-450f-915d-b44fc6de1e97 req-d839c50c-e8cc-4394-83f6-156d201101b6 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8823fc96-374b-450f-915d-b44fc6de1e97 req-d839c50c-e8cc-4394-83f6-156d201101b6 service nova] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8823fc96-374b-450f-915d-b44fc6de1e97 req-d839c50c-e8cc-4394-83f6-156d201101b6 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8823fc96-374b-450f-915d-b44fc6de1e97 req-d839c50c-e8cc-4394-83f6-156d201101b6 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-8823fc96-374b-450f-915d-b44fc6de1e97 req-d839c50c-e8cc-4394-83f6-156d201101b6 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] No waiting events found dispatching network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:50 user nova-compute[74934]: WARNING nova.compute.manager [req-8823fc96-374b-450f-915d-b44fc6de1e97 req-d839c50c-e8cc-4394-83f6-156d201101b6 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received unexpected event network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 for instance with vm_state building and task_state spawning.
Nov 19 15:09:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:09:52 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Instance spawned successfully.
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:09:52 user nova-compute[74934]: INFO nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-09ca1f57-15af-4a9b-b604-7e4716947924 req-5ad79d69-a1dd-4226-ba45-1232355b0d18 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-09ca1f57-15af-4a9b-b604-7e4716947924 req-5ad79d69-a1dd-4226-ba45-1232355b0d18 service nova] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-09ca1f57-15af-4a9b-b604-7e4716947924 req-5ad79d69-a1dd-4226-ba45-1232355b0d18 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-09ca1f57-15af-4a9b-b604-7e4716947924 req-5ad79d69-a1dd-4226-ba45-1232355b0d18 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-09ca1f57-15af-4a9b-b604-7e4716947924 req-5ad79d69-a1dd-4226-ba45-1232355b0d18 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] No waiting events found dispatching network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:52 user nova-compute[74934]: WARNING nova.compute.manager [req-09ca1f57-15af-4a9b-b604-7e4716947924 req-5ad79d69-a1dd-4226-ba45-1232355b0d18 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received unexpected event network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 for instance with vm_state building and task_state spawning.
Nov 19 15:09:52 user nova-compute[74934]: INFO nova.compute.manager [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Took 14.14 seconds to build instance.
Nov 19 15:09:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-842c5c64-388d-4f5a-8bdf-47fc074b8e71 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.246s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:57 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:09:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-changed-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:58 user nova-compute[74934]: DEBUG nova.compute.manager [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Refreshing instance network info cache due to event network-changed-bc25502d-7797-4645-9ef5-da579cc1995c. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:09:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] Acquiring lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:09:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] Acquired lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:09:58 user nova-compute[74934]: DEBUG nova.network.neutron [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Refreshing network info cache for port bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:09:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updated VIF entry in instance network info cache for port bc25502d-7797-4645-9ef5-da579cc1995c. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG nova.network.neutron [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating instance_info_cache with network_info: [{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-8a177f31-2ff4-426e-b639-82c9290c373d req-6578cb6c-ed9b-4f68-b2b5-55adf004e62c service nova] Releasing lock "refresh_cache-e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:09:59 user nova-compute[74934]: INFO nova.compute.manager [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Rebuilding instance
Nov 19 15:09:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-4bb4355c-d5e0-40c1-8b06-8cc54341e128 req-850631e3-789f-4319-a910-d95d9dcc6ed7 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-unplugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4bb4355c-d5e0-40c1-8b06-8cc54341e128 req-850631e3-789f-4319-a910-d95d9dcc6ed7 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4bb4355c-d5e0-40c1-8b06-8cc54341e128 req-850631e3-789f-4319-a910-d95d9dcc6ed7 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4bb4355c-d5e0-40c1-8b06-8cc54341e128 req-850631e3-789f-4319-a910-d95d9dcc6ed7 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:09:59 user nova-compute[74934]: DEBUG nova.compute.manager [req-4bb4355c-d5e0-40c1-8b06-8cc54341e128 req-850631e3-789f-4319-a910-d95d9dcc6ed7 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-unplugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:09:59 user nova-compute[74934]: WARNING nova.compute.manager [req-4bb4355c-d5e0-40c1-8b06-8cc54341e128 req-850631e3-789f-4319-a910-d95d9dcc6ed7 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-unplugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state active and task_state rebuilding.
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance destroyed successfully.
Nov 19 15:10:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance destroyed successfully.
Nov 19 15:10:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-617250874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1667574451',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNpHBeJnBgi1FY+DNo6isZfQxgH6X3Mb5b1YCDnLJbb+D9dFMLkalhjwPgilUlVOz9Eh9EGEhMfSp/GWNhwmyYCMsXy5W9ZbxakpQ5PnbtbVL6Go7aFEcw8lHUdwnQ5+A==',key_name='tempest-keypair-1757474339',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b621639591e845318be1753ccf3a18db',ramdisk_id='',reservation_id='r-o7oyqsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1088824296',owner_user_name='tempest-ServerActionsV293TestJSON-1088824296-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e294f1812948429c67361e43c9c425',uuid=e1cdee34-ff81-4ed0-9d71-d27c027f5b5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converting VIF {"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc25502d-77, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68e2a20f-9694-4861-bfdd-bee53f079885) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:00 user nova-compute[74934]: INFO os_vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77')
Nov 19 15:10:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:10:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b523890c-7d0f-4a92-8c80-d10d1c397278]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:10:00 user nova-compute[74934]: No targets found.
Nov 19 15:10:00 user nova-compute[74934]: iSNS:
Nov 19 15:10:00 user nova-compute[74934]: No targets found.
Nov 19 15:10:00 user nova-compute[74934]: STATIC:
Nov 19 15:10:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1
Nov 19 15:10:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:10:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:10:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44
Nov 19 15:10:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:10:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:10:00 user nova-compute[74934]: FIRMWARE:
Nov 19 15:10:00 user nova-compute[74934]: No targets found.
Nov 19 15:10:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:10:00 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:10:00 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[742d87b7-6afc-4184-b155-bb0885365a7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23878a-b5fd-4b0d-9aa7-17d28b06c154]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:10:00 user nova-compute[74934]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:10:00 user nova-compute[74934]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e409cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8ff24-f2f1-468e-9add-e334836f6656]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfdb703-ddc3-47b8-a45e-031f8d4b05e8]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6d511b-b2be-4ccd-a6f9-f4df0875dae3]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb146de-8f43-4665-a7a1-4d779ca66231]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23631613738303965', '/dev/disk/by-id/scsi-1SCST_BIO141b4a2a-61a7809e8f191537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_141b4a2a') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb99be9-980d-4819-a85b-8a71f962f25e]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[744c75c1-475c-4623-8282-cea52223bf44]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128355f-94d6-4395-8586-c689721c0d4d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]
Nov 19 15:10:00 user nova-compute[74934]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.
Nov 19 15:10:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00cd67-cae2-4ce9-bce9-458a73bf1095]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== disconnect_volume: return (337ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:10:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Deleting instance files /opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d_del
Nov 19 15:10:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Deletion of /opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d_del complete
Nov 19 15:10:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:00 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e1cdee34-ff81-4ed0-9d71-d27c027f5b5d could not be found.
Nov 19 15:10:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:10:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f0112-e374-48d4-be45-5d770cfbd760]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:10:00 user nova-compute[74934]: No targets found.
Nov 19 15:10:00 user nova-compute[74934]: iSNS:
Nov 19 15:10:00 user nova-compute[74934]: No targets found.
Nov 19 15:10:00 user nova-compute[74934]: STATIC:
Nov 19 15:10:00 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1
Nov 19 15:10:00 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:10:00 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:10:00 user nova-compute[74934]: FIRMWARE:
Nov 19 15:10:00 user nova-compute[74934]: No targets found.
Nov 19 15:10:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:10:00 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:10:00 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c8e1d-c92d-4d2e-bfa2-39c5a96aaf47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9420697-902b-4e40-9aad-12facf02f776]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:01 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e41c7490>, {}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Disconnecting from: [] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== disconnect_volume: return (72ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-bb4bdc37-d348-4176-bc3e-73613538f31e req-9c89fd1c-9979-4c65-afd6-6928d4ff83f9 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bb4bdc37-d348-4176-bc3e-73613538f31e req-9c89fd1c-9979-4c65-afd6-6928d4ff83f9 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bb4bdc37-d348-4176-bc3e-73613538f31e req-9c89fd1c-9979-4c65-afd6-6928d4ff83f9 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bb4bdc37-d348-4176-bc3e-73613538f31e req-9c89fd1c-9979-4c65-afd6-6928d4ff83f9 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-bb4bdc37-d348-4176-bc3e-73613538f31e req-9c89fd1c-9979-4c65-afd6-6928d4ff83f9 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:10:01 user nova-compute[74934]: WARNING nova.compute.manager [req-bb4bdc37-d348-4176-bc3e-73613538f31e req-9c89fd1c-9979-4c65-afd6-6928d4ff83f9 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state active and task_state rebuilding.
Nov 19 15:10:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Preparing to wait for external event volume-reimaged-0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 {{(pid=74934) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 19 15:10:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:10:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.145217895507812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e1cdee34-ff81-4ed0-9d71-d27c027f5b5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0fb57f37-ba3d-4829-ba1b-468691944b1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance dedb3c16-b4a4-4533-b0de-97f218d229ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:10:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:10:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:10:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:10:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Updating instance_info_cache with network_info: [{"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:10:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-0fb57f37-ba3d-4829-ba1b-468691944b1f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:10:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:10:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "0fb57f37-ba3d-4829-ba1b-468691944b1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:15 user nova-compute[74934]: INFO nova.compute.manager [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Terminating instance
Nov 19 15:10:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Instance destroyed successfully.
Nov 19 15:10:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lazy-loading 'resources' on Instance uuid 0fb57f37-ba3d-4829-ba1b-468691944b1f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1430775944',display_name='tempest-VolumesActionsTest-instance-1430775944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1430775944',id=43,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ba13b6c4e1f4c9a8835613370a02f28',ramdisk_id='',reservation_id='r-mweayz0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1407456652',owner_user_name='tempest-VolumesActionsTest-1407456652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:08:24Z,user_data=None,user_id='7da57023d23a4927b07cd1c7411dd497',uuid=0fb57f37-ba3d-4829-ba1b-468691944b1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Converting VIF {"id": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "address": "fa:16:3e:13:b2:ec", "network": {"id": "2d6faf30-5363-42a2-a272-709b24ccdec6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2131731973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba13b6c4e1f4c9a8835613370a02f28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4ada76-7d", "ovs_interfaceid": "8b4ada76-7da4-4a35-99a0-9c170f25a02a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG os_vif [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4ada76-7d, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05ba71f8-fd45-40ba-8350-adb89b954ce0) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:15 user nova-compute[74934]: INFO os_vif [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=8b4ada76-7da4-4a35-99a0-9c170f25a02a,network=Network(2d6faf30-5363-42a2-a272-709b24ccdec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4ada76-7d')
Nov 19 15:10:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Deleting instance files /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f_del
Nov 19 15:10:16 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Deletion of /opt/stack/data/nova/instances/0fb57f37-ba3d-4829-ba1b-468691944b1f_del complete
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:16 user nova-compute[74934]: INFO nova.compute.manager [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 19 15:10:16 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:10:17 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Took 1.06 seconds to deallocate network for instance.
Nov 19 15:10:17 user nova-compute[74934]: DEBUG nova.compute.manager [req-b38ec967-44e1-45d0-87d3-d34a699de229 req-be532e7d-4fa6-4d15-a932-2577fc4b475b service nova] [instance: 0fb57f37-ba3d-4829-ba1b-468691944b1f] Received event network-vif-deleted-8b4ada76-7da4-4a35-99a0-9c170f25a02a {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:10:17 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Deleted allocations for instance 0fb57f37-ba3d-4829-ba1b-468691944b1f
Nov 19 15:10:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e6079bbb-ddda-4190-8943-32a09019d82e tempest-VolumesActionsTest-1407456652 tempest-VolumesActionsTest-1407456652-project-member] Lock "0fb57f37-ba3d-4829-ba1b-468691944b1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-586e0971-1686-4ffe-b7f4-c86b7796347e req-e0db919b-d97f-40ef-93ee-a1550df8c2a6 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event volume-reimaged-0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-586e0971-1686-4ffe-b7f4-c86b7796347e req-e0db919b-d97f-40ef-93ee-a1550df8c2a6 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-586e0971-1686-4ffe-b7f4-c86b7796347e req-e0db919b-d97f-40ef-93ee-a1550df8c2a6 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-586e0971-1686-4ffe-b7f4-c86b7796347e req-e0db919b-d97f-40ef-93ee-a1550df8c2a6 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-586e0971-1686-4ffe-b7f4-c86b7796347e req-e0db919b-d97f-40ef-93ee-a1550df8c2a6 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Processing event volume-reimaged-0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:10:19 user nova-compute[74934]: INFO nova.virt.block_device [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Booting with volume 0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 at /dev/vda
Nov 19 15:10:19 user nova-compute[74934]: DEBUG os_brick.utils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0cd960-11b2-4343-9fb2-cbccd91afbc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9722876b-cfad-4691-8c6f-fe368f019cb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8557ee-dabb-4805-b7af-3d08d7f2dda5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad0108-30a5-4837-9be1-6030baa4d504]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:10:19 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:10:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[53707c97-2fe7-495b-a3d8-9a44a1ef9c96]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG os_brick.utils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:10:19 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating existing volume attachment record: 1e184be3-7ae0-42da-8f77-1cba58b1fc24 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:10:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:10:21 user nova-compute[74934]: INFO nova.compute.claims [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Claim successful on node user
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:10:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.policy [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f86f10cdf0464797a6ba95a09733e72e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a07100dee4a149493e8ada494a7c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:10:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Creating image(s)
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "/opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "/opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk 1073741824" returned: 0 in 0.046s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Successfully created port: bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.195s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Cannot resize image /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Ensure instance console log exists: /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Successfully updated port: bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquired lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-changed-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Refreshing instance network info cache due to event network-changed-bba96a48-ec95-4fec-bb63-1c684306ef25. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:10:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] Acquiring lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating instance_info_cache with network_info: [{"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Releasing lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Instance network_info: |[{"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] Acquired lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.neutron [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Refreshing network info cache for port bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Start _get_guest_xml network_info=[{"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:10:23 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:10:23 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9127891',id=45,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDztRitpipyFx9zYNLm3gGUmj6HGWQjmjgqoIwwcAJ6vmh/otLIgkvyU3a3Uwj0QP/I8H0JSbSZd+2m9p+QJAl37w6o3QN30X+gLMy5g7EeWRLlKvD8W1szHJPn/aCwDyQ==',key_name='tempest-keypair-1853409064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='647a07100dee4a149493e8ada494a7c0',ramdisk_id='',reservation_id='r-zcs8xwwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-816509203',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f86f10cdf0464797a6ba95a09733e72e',uuid=d3bc7763-2e66-424b-a60e-35f1134f5dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Converting VIF {"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lazy-loading 'pci_devices' on Instance uuid d3bc7763-2e66-424b-a60e-35f1134f5dc6 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:10:23 user nova-compute[74934]:   <uuid>d3bc7763-2e66-424b-a60e-35f1134f5dc6</uuid>
Nov 19 15:10:23 user nova-compute[74934]:   <name>instance-0000002d</name>
Nov 19 15:10:23 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:10:23 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:10:23 user nova-compute[74934]:   <metadata>
Nov 19 15:10:23 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:10:23 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:10:23 user nova-compute[74934]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150</nova:name>
Nov 19 15:10:23 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:10:23</nova:creationTime>
Nov 19 15:10:23 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:10:23 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:10:23 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:10:23 user nova-compute[74934]:       <nova:owner>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:user uuid="f86f10cdf0464797a6ba95a09733e72e">tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member</nova:user>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:project uuid="647a07100dee4a149493e8ada494a7c0">tempest-TestServerVolumeAttachScenarioOldVersion-816509203</nova:project>
Nov 19 15:10:23 user nova-compute[74934]:       </nova:owner>
Nov 19 15:10:23 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:10:23 user nova-compute[74934]:       <nova:ports>
Nov 19 15:10:23 user nova-compute[74934]:         <nova:port uuid="bba96a48-ec95-4fec-bb63-1c684306ef25">
Nov 19 15:10:23 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 19 15:10:23 user nova-compute[74934]:         </nova:port>
Nov 19 15:10:23 user nova-compute[74934]:       </nova:ports>
Nov 19 15:10:23 user nova-compute[74934]:     </nova:instance>
Nov 19 15:10:23 user nova-compute[74934]:   </metadata>
Nov 19 15:10:23 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:10:23 user nova-compute[74934]:     <system>
Nov 19 15:10:23 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:10:23 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:10:23 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:10:23 user nova-compute[74934]:       <entry name="serial">d3bc7763-2e66-424b-a60e-35f1134f5dc6</entry>
Nov 19 15:10:23 user nova-compute[74934]:       <entry name="uuid">d3bc7763-2e66-424b-a60e-35f1134f5dc6</entry>
Nov 19 15:10:23 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:10:23 user nova-compute[74934]:     </system>
Nov 19 15:10:23 user nova-compute[74934]:   </sysinfo>
Nov 19 15:10:23 user nova-compute[74934]:   <os>
Nov 19 15:10:23 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:10:23 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:10:23 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:10:23 user nova-compute[74934]:   </os>
Nov 19 15:10:23 user nova-compute[74934]:   <features>
Nov 19 15:10:23 user nova-compute[74934]:     <acpi/>
Nov 19 15:10:23 user nova-compute[74934]:     <apic/>
Nov 19 15:10:23 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:10:23 user nova-compute[74934]:   </features>
Nov 19 15:10:23 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:10:23 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:10:23 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:10:23 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:10:23 user nova-compute[74934]:   </clock>
Nov 19 15:10:23 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:10:23 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:10:23 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:10:23 user nova-compute[74934]:   </cpu>
Nov 19 15:10:23 user nova-compute[74934]:   <devices>
Nov 19 15:10:23 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:10:23 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:10:23 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk"/>
Nov 19 15:10:23 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:10:23 user nova-compute[74934]:     </disk>
Nov 19 15:10:23 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:10:23 user nova-compute[74934]:       <mac address="fa:16:3e:32:28:e4"/>
Nov 19 15:10:23 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:10:23 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:10:23 user nova-compute[74934]:       <target dev="tapbba96a48-ec"/>
Nov 19 15:10:23 user nova-compute[74934]:     </interface>
Nov 19 15:10:23 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:10:23 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/console.log" append="off"/>
Nov 19 15:10:23 user nova-compute[74934]:     </serial>
Nov 19 15:10:23 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:10:23 user nova-compute[74934]:     <video>
Nov 19 15:10:23 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:10:23 user nova-compute[74934]:     </video>
Nov 19 15:10:23 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:10:23 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:10:23 user nova-compute[74934]:     </rng>
Nov 19 15:10:23 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:10:23 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:10:23 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:10:23 user nova-compute[74934]:     </memballoon>
Nov 19 15:10:23 user nova-compute[74934]:   </devices>
Nov 19 15:10:23 user nova-compute[74934]: </domain>
Nov 19 15:10:23 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9127891',id=45,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDztRitpipyFx9zYNLm3gGUmj6HGWQjmjgqoIwwcAJ6vmh/otLIgkvyU3a3Uwj0QP/I8H0JSbSZd+2m9p+QJAl37w6o3QN30X+gLMy5g7EeWRLlKvD8W1szHJPn/aCwDyQ==',key_name='tempest-keypair-1853409064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='647a07100dee4a149493e8ada494a7c0',ramdisk_id='',reservation_id='r-zcs8xwwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-816509203',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f86f10cdf0464797a6ba95a09733e72e',uuid=d3bc7763-2e66-424b-a60e-35f1134f5dc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Converting VIF {"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG os_vif [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c22f417b-eaae-5ef3-9991-c311b1962cb0', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbba96a48-ec, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbba96a48-ec, col_values=(('qos', UUID('4c2f5deb-5d56-4937-a541-cc526bdd0968')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbba96a48-ec, col_values=(('external_ids', {'iface-id': 'bba96a48-ec95-4fec-bb63-1c684306ef25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:28:e4', 'vm-uuid': 'd3bc7763-2e66-424b-a60e-35f1134f5dc6'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:23 user nova-compute[74934]: INFO os_vif [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec')
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] No VIF found with MAC fa:16:3e:32:28:e4, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.neutron [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updated VIF entry in instance network info cache for port bba96a48-ec95-4fec-bb63-1c684306ef25. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG nova.network.neutron [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating instance_info_cache with network_info: [{"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:10:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dcfe4fe3-8b00-485c-bb8d-07fa0983fff1 req-de515efb-c35a-4165-9906-2ca11b3512fe service nova] Releasing lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-dcda9907-a0e4-4bd7-8f19-71728385f2cb req-4cae1533-e2df-475c-b1d8-7af20113dbbe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dcda9907-a0e4-4bd7-8f19-71728385f2cb req-4cae1533-e2df-475c-b1d8-7af20113dbbe service nova] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dcda9907-a0e4-4bd7-8f19-71728385f2cb req-4cae1533-e2df-475c-b1d8-7af20113dbbe service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dcda9907-a0e4-4bd7-8f19-71728385f2cb req-4cae1533-e2df-475c-b1d8-7af20113dbbe service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:24 user nova-compute[74934]: DEBUG nova.compute.manager [req-dcda9907-a0e4-4bd7-8f19-71728385f2cb req-4cae1533-e2df-475c-b1d8-7af20113dbbe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] No waiting events found dispatching network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:10:24 user nova-compute[74934]: WARNING nova.compute.manager [req-dcda9907-a0e4-4bd7-8f19-71728385f2cb req-4cae1533-e2df-475c-b1d8-7af20113dbbe service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received unexpected event network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 for instance with vm_state building and task_state spawning.
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:10:25 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Creating image(s)
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Ensure instance console log exists: /opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Start _get_guest_xml network_info=[{"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '1e184be3-7ae0-42da-8f77-1cba58b1fc24', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1cdee34-ff81-4ed0-9d71-d27c027f5b5d', 'attached_at': '', 'detached_at': '', 'volume_id': '0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'serial': '0eca6d1c-fc56-4860-9a5c-981aa1fd5a44'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:10:25 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 19 15:10:25 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.objects.instance [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1cdee34-ff81-4ed0-9d71-d27c027f5b5d {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:10:25 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:10:25 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:10:25 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[426eff32-d3e2-4916-af29-d64f93bb4001]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:10:25 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee46507-f8ad-41e4-9463-f8164e8c753e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44] added
Nov 19 15:10:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3134472d-b420-431c-b13f-11e2fb0eede8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[002a6e43-0633-4f9c-80d8-29f5b64d1807]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEwRAxcm {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uEwRAxcm" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[100eaf3a-ae92-46c6-a035-8e3585674bd5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uEwRAxcm'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4777ca-6cf9-49f4-84a3-407d36b0e033]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9084ebf9-e648-4537-bfeb-a1d3386f7d15]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe44f4-cd25-4bb6-ab4b-7f5f99be98fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]
Nov 19 15:10:25 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.
Nov 19 15:10:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c580cd58-3f33-4aff-9778-e4b17b294a11]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88b523-581e-45af-b747-aaf99f5c7a4b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:25 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:10:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:10:25 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:10:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b76b88-9e5d-4e02-a92b-4d5bab338ecf]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:10:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23631613738303965', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631613738303965', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-617250874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1667574451',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNpHBeJnBgi1FY+DNo6isZfQxgH6X3Mb5b1YCDnLJbb+D9dFMLkalhjwPgilUlVOz9Eh9EGEhMfSp/GWNhwmyYCMsXy5W9ZbxakpQ5PnbtbVL6Go7aFEcw8lHUdwnQ5+A==',key_name='tempest-keypair-1757474339',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b621639591e845318be1753ccf3a18db',ramdisk_id='',reservation_id='r-o7oyqsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1088824296',owner_user_name='tempest-ServerActionsV293TestJSON-1088824296-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e294f1812948429c67361e43c9c425',uuid=e1cdee34-ff81-4ed0-9d71-d27c027f5b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converting VIF {"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:10:26 user nova-compute[74934]:   <uuid>e1cdee34-ff81-4ed0-9d71-d27c027f5b5d</uuid>
Nov 19 15:10:26 user nova-compute[74934]:   <name>instance-0000002a</name>
Nov 19 15:10:26 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:10:26 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:10:26 user nova-compute[74934]:   <metadata>
Nov 19 15:10:26 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:10:26 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:10:26 user nova-compute[74934]:       <nova:name>tempest-ServerActionsV293TestJSON-server-617250874</nova:name>
Nov 19 15:10:26 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:10:25</nova:creationTime>
Nov 19 15:10:26 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:10:26 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:10:26 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:10:26 user nova-compute[74934]:       <nova:owner>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:user uuid="c4e294f1812948429c67361e43c9c425">tempest-ServerActionsV293TestJSON-1088824296-project-member</nova:user>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:project uuid="b621639591e845318be1753ccf3a18db">tempest-ServerActionsV293TestJSON-1088824296</nova:project>
Nov 19 15:10:26 user nova-compute[74934]:       </nova:owner>
Nov 19 15:10:26 user nova-compute[74934]:       <nova:ports>
Nov 19 15:10:26 user nova-compute[74934]:         <nova:port uuid="bc25502d-7797-4645-9ef5-da579cc1995c">
Nov 19 15:10:26 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 15:10:26 user nova-compute[74934]:         </nova:port>
Nov 19 15:10:26 user nova-compute[74934]:       </nova:ports>
Nov 19 15:10:26 user nova-compute[74934]:     </nova:instance>
Nov 19 15:10:26 user nova-compute[74934]:   </metadata>
Nov 19 15:10:26 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:10:26 user nova-compute[74934]:     <system>
Nov 19 15:10:26 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:10:26 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:10:26 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:10:26 user nova-compute[74934]:       <entry name="serial">e1cdee34-ff81-4ed0-9d71-d27c027f5b5d</entry>
Nov 19 15:10:26 user nova-compute[74934]:       <entry name="uuid">e1cdee34-ff81-4ed0-9d71-d27c027f5b5d</entry>
Nov 19 15:10:26 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:10:26 user nova-compute[74934]:     </system>
Nov 19 15:10:26 user nova-compute[74934]:   </sysinfo>
Nov 19 15:10:26 user nova-compute[74934]:   <os>
Nov 19 15:10:26 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:10:26 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:10:26 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:10:26 user nova-compute[74934]:   </os>
Nov 19 15:10:26 user nova-compute[74934]:   <features>
Nov 19 15:10:26 user nova-compute[74934]:     <acpi/>
Nov 19 15:10:26 user nova-compute[74934]:     <apic/>
Nov 19 15:10:26 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:10:26 user nova-compute[74934]:   </features>
Nov 19 15:10:26 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:10:26 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:10:26 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:10:26 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:10:26 user nova-compute[74934]:   </clock>
Nov 19 15:10:26 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:10:26 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:10:26 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:10:26 user nova-compute[74934]:   </cpu>
Nov 19 15:10:26 user nova-compute[74934]:   <devices>
Nov 19 15:10:26 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:10:26 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:10:26 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 15:10:26 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:10:26 user nova-compute[74934]:       <serial>0eca6d1c-fc56-4860-9a5c-981aa1fd5a44</serial>
Nov 19 15:10:26 user nova-compute[74934]:     </disk>
Nov 19 15:10:26 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:10:26 user nova-compute[74934]:       <mac address="fa:16:3e:60:f6:b4"/>
Nov 19 15:10:26 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:10:26 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:10:26 user nova-compute[74934]:       <target dev="tapbc25502d-77"/>
Nov 19 15:10:26 user nova-compute[74934]:     </interface>
Nov 19 15:10:26 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:10:26 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d/console.log" append="off"/>
Nov 19 15:10:26 user nova-compute[74934]:     </serial>
Nov 19 15:10:26 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:10:26 user nova-compute[74934]:     <video>
Nov 19 15:10:26 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:10:26 user nova-compute[74934]:     </video>
Nov 19 15:10:26 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:10:26 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:10:26 user nova-compute[74934]:     </rng>
Nov 19 15:10:26 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:10:26 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:10:26 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:10:26 user nova-compute[74934]:     </memballoon>
Nov 19 15:10:26 user nova-compute[74934]:   </devices>
Nov 19 15:10:26 user nova-compute[74934]: </domain>
Nov 19 15:10:26 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-617250874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1667574451',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNpHBeJnBgi1FY+DNo6isZfQxgH6X3Mb5b1YCDnLJbb+D9dFMLkalhjwPgilUlVOz9Eh9EGEhMfSp/GWNhwmyYCMsXy5W9ZbxakpQ5PnbtbVL6Go7aFEcw8lHUdwnQ5+A==',key_name='tempest-keypair-1757474339',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b621639591e845318be1753ccf3a18db',ramdisk_id='',reservation_id='r-o7oyqsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1088824296',owner_user_name='tempest-ServerActionsV293TestJSON-1088824296-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e294f1812948429c67361e43c9c425',uuid=e1cdee34-ff81-4ed0-9d71-d27c027f5b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converting VIF {"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG os_vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af0218fc-fb7b-5766-a514-e60ae0389028', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc25502d-77, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc25502d-77, col_values=(('qos', UUID('87d681c6-0343-4bc6-ba88-7f5e6e353a98')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc25502d-77, col_values=(('external_ids', {'iface-id': 'bc25502d-7797-4645-9ef5-da579cc1995c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:f6:b4', 'vm-uuid': 'e1cdee34-ff81-4ed0-9d71-d27c027f5b5d'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:26 user nova-compute[74934]: INFO os_vif [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77')
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] No VIF found with MAC fa:16:3e:60:f6:b4, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:10:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Instance spawned successfully.
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-12cb46c5-12a3-4d72-96f7-c7e2f9460746 req-5e3280e4-629c-44ac-9fa8-1f21dabcd19d service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-12cb46c5-12a3-4d72-96f7-c7e2f9460746 req-5e3280e4-629c-44ac-9fa8-1f21dabcd19d service nova] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-12cb46c5-12a3-4d72-96f7-c7e2f9460746 req-5e3280e4-629c-44ac-9fa8-1f21dabcd19d service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-12cb46c5-12a3-4d72-96f7-c7e2f9460746 req-5e3280e4-629c-44ac-9fa8-1f21dabcd19d service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-12cb46c5-12a3-4d72-96f7-c7e2f9460746 req-5e3280e4-629c-44ac-9fa8-1f21dabcd19d service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] No waiting events found dispatching network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:10:26 user nova-compute[74934]: WARNING nova.compute.manager [req-12cb46c5-12a3-4d72-96f7-c7e2f9460746 req-5e3280e4-629c-44ac-9fa8-1f21dabcd19d service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received unexpected event network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 for instance with vm_state building and task_state spawning.
Nov 19 15:10:27 user nova-compute[74934]: INFO nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 19 15:10:27 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:10:27 user nova-compute[74934]: INFO nova.compute.manager [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Took 5.85 seconds to build instance.
Nov 19 15:10:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ffb9306a-a4ff-459c-bcd2-6d1efb2f0174 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.100s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:10:29 user nova-compute[74934]: WARNING nova.compute.manager [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state active and task_state rebuild_spawning.
Nov 19 15:10:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:10:29 user nova-compute[74934]: WARNING nova.compute.manager [req-c74fcbca-27c5-45e6-82c3-d0ee1526961d req-56cee9fd-9bac-4e1b-a8e5-144e0d785aa5 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state active and task_state rebuild_spawning.
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:10:30 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance spawned successfully.
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG nova.objects.instance [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74934) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-586e0971-1686-4ffe-b7f4-c86b7796347e tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.114s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:10:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:10:58 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:11:06 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid dedb3c16-b4a4-4533-b0de-97f218d229ea {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating instance_info_cache with network_info: [{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:11:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:11:08 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:11:08 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.133132934570312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance e1cdee34-ff81-4ed0-9d71-d27c027f5b5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance dedb3c16-b4a4-4533-b0de-97f218d229ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:11:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:11:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:11:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:11:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:11:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-changed-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG nova.compute.manager [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Refreshing instance network info cache due to event network-changed-58fd1e88-8d8a-42cf-9b6f-2580461947e1. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] Acquiring lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] Acquired lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG nova.network.neutron [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Refreshing network info cache for port 58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG nova.network.neutron [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updated VIF entry in instance network info cache for port 58fd1e88-8d8a-42cf-9b6f-2580461947e1. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG nova.network.neutron [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating instance_info_cache with network_info: [{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:11:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d610ad7f-0c7b-4200-b562-bf6703067a6b req-c06aca69-3809-4f0b-ba6a-509a3b121086 service nova] Releasing lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:11:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:34 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:11:34 user nova-compute[74934]: INFO nova.compute.claims [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Claim successful on node user
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:11:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:11:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:11:35 user nova-compute[74934]: INFO nova.virt.block_device [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Booting with volume snapshot 3889f804-081d-48ff-ad9b-482d00b73e8c at /dev/vda
Nov 19 15:11:35 user nova-compute[74934]: DEBUG nova.policy [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ade11c889684ca9b402fa1066e4b629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441622bd90c1460fb78ac8ebdbead719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:11:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Successfully created port: 274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:11:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Successfully updated port: 274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquired lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-changed-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.compute.manager [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Refreshing instance network info cache due to event network-changed-274d1394-0810-439c-a162-155bffb323ba. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] Acquiring lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.network.neutron [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updating instance_info_cache with network_info: [{"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Releasing lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Instance network_info: |[{"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] Acquired lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:11:37 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Refreshing network info cache for port 274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:11:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updated VIF entry in instance network info cache for port 274d1394-0810-439c-a162-155bffb323ba. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:11:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updating instance_info_cache with network_info: [{"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:11:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-ef03be02-1b88-4bc8-a8e1-e19d6c1547f6 req-c3927c0b-065e-46a1-87e5-5b6e6a119d4e service nova] Releasing lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG os_brick.utils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3436b1-6a7b-4e91-83e5-72d5d0241da9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f916e-f340-485c-85ff-0296683186cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a015f511-ecc9-44ef-96cf-66fb108aa8fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb10c14-7a50-4bff-9ae5-15c2c42a66fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:11:41 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:11:41 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b03809-b92e-447d-ba6f-37ae94baa6fc]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG os_brick.utils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updating existing volume attachment record: 6799666f-c487-4719-b4c0-39c8055bb92f {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:11:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:11:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Creating image(s)
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Ensure instance console log exists: /opt/stack/data/nova/instances/d9f0a9a8-e57a-4cec-8477-0d7af9395da0/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Start _get_guest_xml network_info=[{"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-19T15:11:31Z,direct_url=<?>,disk_format='qcow2',id=5d6bfc93-a68c-4b9c-bcaf-c59621253207,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-334522693',owner='441622bd90c1460fb78ac8ebdbead719',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-19T15:11:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'attachment_id': '6799666f-c487-4719-b4c0-39c8055bb92f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdRaeMJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd9f0a9a8-e57a-4cec-8477-0d7af9395da0', 'attached_at': '', 'detached_at': '', 'volume_id': 'cacecfa1-546b-4d27-9102-33e0a38056a3', 'serial': 'cacecfa1-546b-4d27-9102-33e0a38056a3'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:11:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:11:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-19T15:11:31Z,direct_url=<?>,disk_format='qcow2',id=5d6bfc93-a68c-4b9c-bcaf-c59621253207,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-334522693',owner='441622bd90c1460fb78ac8ebdbead719',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-19T15:11:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdRaeMJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:11:50 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:11:50 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:11:50 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17aebf2-b13e-40a3-913e-be2d15cc4ab1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:11:50 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ba5c7-0558-4f5c-9763-da767f48a0a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3] added
Nov 19 15:11:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97bd87-b3c6-42ae-8dfb-76eaa6fa7684]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c90ebf9-764f-4cea-98f7-1986346ed7f8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdRaeMJV {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdRaeMJV" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6802e781-e950-44c8-b05c-b53d97e5c28a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdRaeMJV'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1de9aaa-6c03-4d1a-a33a-7645262b33da]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9346f9c6-da67-4986-bb8d-235056e13e9d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851bf6a-629d-4675-98af-5609d6d3712e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260]
Nov 19 15:11:50 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260] successful.
Nov 19 15:11:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37e72c8-293c-46b9-8f71-a49135935523]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b045f5-bb1c-4b65-be6c-d593732b49a5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:11:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a79a5-8f88-4f28-8e39-a996dfb8c8dd]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:11:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:51 user nova-compute[74934]: INFO nova.compute.manager [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Terminating instance
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c1552255-e83e-4d79-87f6-4ee5c6ea7353 req-25bee75d-c5b9-425e-bd97-d375d485ade1 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-unplugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c1552255-e83e-4d79-87f6-4ee5c6ea7353 req-25bee75d-c5b9-425e-bd97-d375d485ade1 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c1552255-e83e-4d79-87f6-4ee5c6ea7353 req-25bee75d-c5b9-425e-bd97-d375d485ade1 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c1552255-e83e-4d79-87f6-4ee5c6ea7353 req-25bee75d-c5b9-425e-bd97-d375d485ade1 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c1552255-e83e-4d79-87f6-4ee5c6ea7353 req-25bee75d-c5b9-425e-bd97-d375d485ade1 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-unplugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c1552255-e83e-4d79-87f6-4ee5c6ea7353 req-25bee75d-c5b9-425e-bd97-d375d485ade1 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-unplugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdRaeMJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23431326434613531', 'path': '/dev/sdd'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431326434613531', 'path': '/dev/sdd'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1121508690',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1121508690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1121508690',id=46,image_ref='5d6bfc93-a68c-4b9c-bcaf-c59621253207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDtFbudqK/TwFy74VMqtrWVoJFPaEzvHjaM11hd9r3eFMDrotJ9A1OG9bpfFflfiDEj+L1yjZcXepiF7Zq9YUxAUi0FCxhM/91wILMOWthCkLTkjgxyr/bSh4LFVj0D6g==',key_name='tempest-keypair-646976785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-w8fjizpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-686579107',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ade11c889684ca9b402fa1066e4b629',uuid=d9f0a9a8-e57a-4cec-8477-0d7af9395da0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.objects.instance [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'pci_devices' on Instance uuid d9f0a9a8-e57a-4cec-8477-0d7af9395da0 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:11:51 user nova-compute[74934]:   <uuid>d9f0a9a8-e57a-4cec-8477-0d7af9395da0</uuid>
Nov 19 15:11:51 user nova-compute[74934]:   <name>instance-0000002e</name>
Nov 19 15:11:51 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:11:51 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:11:51 user nova-compute[74934]:   <metadata>
Nov 19 15:11:51 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:11:51 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:11:51 user nova-compute[74934]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1121508690</nova:name>
Nov 19 15:11:51 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:11:50</nova:creationTime>
Nov 19 15:11:51 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:11:51 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:11:51 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:11:51 user nova-compute[74934]:       <nova:owner>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:user uuid="3ade11c889684ca9b402fa1066e4b629">tempest-TestVolumeBootPattern-686579107-project-member</nova:user>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:project uuid="441622bd90c1460fb78ac8ebdbead719">tempest-TestVolumeBootPattern-686579107</nova:project>
Nov 19 15:11:51 user nova-compute[74934]:       </nova:owner>
Nov 19 15:11:51 user nova-compute[74934]:       <nova:root type="image" uuid="5d6bfc93-a68c-4b9c-bcaf-c59621253207"/>
Nov 19 15:11:51 user nova-compute[74934]:       <nova:ports>
Nov 19 15:11:51 user nova-compute[74934]:         <nova:port uuid="274d1394-0810-439c-a162-155bffb323ba">
Nov 19 15:11:51 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 19 15:11:51 user nova-compute[74934]:         </nova:port>
Nov 19 15:11:51 user nova-compute[74934]:       </nova:ports>
Nov 19 15:11:51 user nova-compute[74934]:     </nova:instance>
Nov 19 15:11:51 user nova-compute[74934]:   </metadata>
Nov 19 15:11:51 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:11:51 user nova-compute[74934]:     <system>
Nov 19 15:11:51 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:11:51 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:11:51 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:11:51 user nova-compute[74934]:       <entry name="serial">d9f0a9a8-e57a-4cec-8477-0d7af9395da0</entry>
Nov 19 15:11:51 user nova-compute[74934]:       <entry name="uuid">d9f0a9a8-e57a-4cec-8477-0d7af9395da0</entry>
Nov 19 15:11:51 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:11:51 user nova-compute[74934]:     </system>
Nov 19 15:11:51 user nova-compute[74934]:   </sysinfo>
Nov 19 15:11:51 user nova-compute[74934]:   <os>
Nov 19 15:11:51 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:11:51 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:11:51 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:11:51 user nova-compute[74934]:   </os>
Nov 19 15:11:51 user nova-compute[74934]:   <features>
Nov 19 15:11:51 user nova-compute[74934]:     <acpi/>
Nov 19 15:11:51 user nova-compute[74934]:     <apic/>
Nov 19 15:11:51 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:11:51 user nova-compute[74934]:   </features>
Nov 19 15:11:51 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:11:51 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:11:51 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:11:51 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:11:51 user nova-compute[74934]:   </clock>
Nov 19 15:11:51 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:11:51 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:11:51 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:11:51 user nova-compute[74934]:   </cpu>
Nov 19 15:11:51 user nova-compute[74934]:   <devices>
Nov 19 15:11:51 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:11:51 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:11:51 user nova-compute[74934]:       <source dev="/dev/sdd"/>
Nov 19 15:11:51 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:11:51 user nova-compute[74934]:       <serial>cacecfa1-546b-4d27-9102-33e0a38056a3</serial>
Nov 19 15:11:51 user nova-compute[74934]:     </disk>
Nov 19 15:11:51 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:11:51 user nova-compute[74934]:       <mac address="fa:16:3e:8b:82:73"/>
Nov 19 15:11:51 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:11:51 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:11:51 user nova-compute[74934]:       <target dev="tap274d1394-08"/>
Nov 19 15:11:51 user nova-compute[74934]:     </interface>
Nov 19 15:11:51 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:11:51 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/d9f0a9a8-e57a-4cec-8477-0d7af9395da0/console.log" append="off"/>
Nov 19 15:11:51 user nova-compute[74934]:     </serial>
Nov 19 15:11:51 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:11:51 user nova-compute[74934]:     <video>
Nov 19 15:11:51 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:11:51 user nova-compute[74934]:     </video>
Nov 19 15:11:51 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:11:51 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:11:51 user nova-compute[74934]:     </rng>
Nov 19 15:11:51 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:11:51 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:11:51 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:11:51 user nova-compute[74934]:     </memballoon>
Nov 19 15:11:51 user nova-compute[74934]:   </devices>
Nov 19 15:11:51 user nova-compute[74934]: </domain>
Nov 19 15:11:51 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1121508690',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1121508690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1121508690',id=46,image_ref='5d6bfc93-a68c-4b9c-bcaf-c59621253207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDtFbudqK/TwFy74VMqtrWVoJFPaEzvHjaM11hd9r3eFMDrotJ9A1OG9bpfFflfiDEj+L1yjZcXepiF7Zq9YUxAUi0FCxhM/91wILMOWthCkLTkjgxyr/bSh4LFVj0D6g==',key_name='tempest-keypair-646976785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-w8fjizpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-686579107',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ade11c889684ca9b402fa1066e4b629',uuid=d9f0a9a8-e57a-4cec-8477-0d7af9395da0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_vif [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4950df15-7a82-500a-98f2-09c944798144', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap274d1394-08, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap274d1394-08, col_values=(('qos', UUID('29e278cc-c3e1-44d5-afee-5f6a4b3442a1')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap274d1394-08, col_values=(('external_ids', {'iface-id': '274d1394-0810-439c-a162-155bffb323ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:82:73', 'vm-uuid': 'd9f0a9a8-e57a-4cec-8477-0d7af9395da0'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: INFO os_vif [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08')
Nov 19 15:11:51 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Instance destroyed successfully.
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.objects.instance [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lazy-loading 'resources' on Instance uuid e1cdee34-ff81-4ed0-9d71-d27c027f5b5d {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-19T15:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-617250874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1667574451',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNpHBeJnBgi1FY+DNo6isZfQxgH6X3Mb5b1YCDnLJbb+D9dFMLkalhjwPgilUlVOz9Eh9EGEhMfSp/GWNhwmyYCMsXy5W9ZbxakpQ5PnbtbVL6Go7aFEcw8lHUdwnQ5+A==',key_name='tempest-keypair-1757474339',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:10:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b621639591e845318be1753ccf3a18db',ramdisk_id='',reservation_id='r-o7oyqsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1088824296',owner_user_name='tempest-ServerActionsV293TestJSON-1088824296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:10:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e294f1812948429c67361e43c9c425',uuid=e1cdee34-ff81-4ed0-9d71-d27c027f5b5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converting VIF {"id": "bc25502d-7797-4645-9ef5-da579cc1995c", "address": "fa:16:3e:60:f6:b4", "network": {"id": "801f7ce0-7e9b-4adc-8867-f72dc8f95866", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1464958157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b621639591e845318be1753ccf3a18db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc25502d-77", "ovs_interfaceid": "bc25502d-7797-4645-9ef5-da579cc1995c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_vif [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc25502d-77, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87d681c6-0343-4bc6-ba88-7f5e6e353a98) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:51 user nova-compute[74934]: INFO os_vif [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:f6:b4,bridge_name='br-int',has_traffic_filtering=True,id=bc25502d-7797-4645-9ef5-da579cc1995c,network=Network(801f7ce0-7e9b-4adc-8867-f72dc8f95866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc25502d-77')
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No VIF found with MAC fa:16:3e:8b:82:73, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uEwRAxcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:11:51 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a8534b-0875-4251-bdc7-1cf475996de3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:11:51 user nova-compute[74934]: No targets found.
Nov 19 15:11:51 user nova-compute[74934]: iSNS:
Nov 19 15:11:51 user nova-compute[74934]: No targets found.
Nov 19 15:11:51 user nova-compute[74934]: STATIC:
Nov 19 15:11:51 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1
Nov 19 15:11:51 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:11:51 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:11:51 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3
Nov 19 15:11:51 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:11:51 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:11:51 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44
Nov 19 15:11:51 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:11:51 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:11:51 user nova-compute[74934]: FIRMWARE:
Nov 19 15:11:51 user nova-compute[74934]: No targets found.
Nov 19 15:11:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:11:51 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:11:51 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea58765c-af1b-4c6a-95ce-824ba3804f9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe3752-d02a-4786-93c0-0f83f3af3050]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:11:51 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:11:51 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:11:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:11:51 user nova-compute[74934]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 (non-flash)
Nov 19 15:11:51 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:11:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c45bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55cea0c-a4d2-4262-a870-f61eec6e342c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b84a9f-9dfe-49f0-8d59-daf578d6aff5]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86102f-c6a5-4b2d-824d-3483e7a71d44]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:11:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98c8a8-9b08-4f87-83f6-14d9d11a5f0d]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23631613738303965', '/dev/disk/by-id/scsi-1SCST_BIO141b4a2a-61a7809e8f191537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_141b4a2a') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[819746db-732d-4f82-a79f-4113543e2fd1]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d849faf-cda8-4239-b9b6-3ecc571eb08e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2c7f7d-0a3c-4c82-8616-de0fe157cdb2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260]
Nov 19 15:11:52 user nova-compute[74934]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44, portal: 172.16.0.220,3260] successful.
Nov 19 15:11:52 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[08740055-cd8e-4c7a-ba96-f340bf5332c1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] <== disconnect_volume: return (328ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:11:52 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Deleting instance files /opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d_del
Nov 19 15:11:52 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Deletion of /opt/stack/data/nova/instances/e1cdee34-ff81-4ed0-9d71-d27c027f5b5d_del complete
Nov 19 15:11:52 user nova-compute[74934]: INFO nova.compute.manager [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 19 15:11:52 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:11:52 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:53 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Took 0.83 seconds to deallocate network for instance.
Nov 19 15:11:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-51eeaf28-d1d6-4051-a4da-ea13cf37a36d req-0e71a221-aa11-4206-a9ec-5bba30cfcd9c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-deleted-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:53 user nova-compute[74934]: INFO nova.compute.manager [req-51eeaf28-d1d6-4051-a4da-ea13cf37a36d req-0e71a221-aa11-4206-a9ec-5bba30cfcd9c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Neutron deleted interface bc25502d-7797-4645-9ef5-da579cc1995c; detaching it from the instance and deleting it from the info cache
Nov 19 15:11:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-51eeaf28-d1d6-4051-a4da-ea13cf37a36d req-0e71a221-aa11-4206-a9ec-5bba30cfcd9c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-51eeaf28-d1d6-4051-a4da-ea13cf37a36d req-0e71a221-aa11-4206-a9ec-5bba30cfcd9c service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Detach interface failed, port_id=bc25502d-7797-4645-9ef5-da579cc1995c, reason: Instance e1cdee34-ff81-4ed0-9d71-d27c027f5b5d could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-f3b14a93-282e-41ff-95be-616da19f4529 req-6b6a1197-5c17-4352-9e2c-68302b780cb8 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f3b14a93-282e-41ff-95be-616da19f4529 req-6b6a1197-5c17-4352-9e2c-68302b780cb8 service nova] Acquiring lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f3b14a93-282e-41ff-95be-616da19f4529 req-6b6a1197-5c17-4352-9e2c-68302b780cb8 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-f3b14a93-282e-41ff-95be-616da19f4529 req-6b6a1197-5c17-4352-9e2c-68302b780cb8 service nova] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-f3b14a93-282e-41ff-95be-616da19f4529 req-6b6a1197-5c17-4352-9e2c-68302b780cb8 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] No waiting events found dispatching network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:11:53 user nova-compute[74934]: WARNING nova.compute.manager [req-f3b14a93-282e-41ff-95be-616da19f4529 req-6b6a1197-5c17-4352-9e2c-68302b780cb8 service nova] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Received unexpected event network-vif-plugged-bc25502d-7797-4645-9ef5-da579cc1995c for instance with vm_state active and task_state deleting.
Nov 19 15:11:54 user nova-compute[74934]: INFO nova.compute.manager [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Took 1.12 seconds to detach 1 volumes for instance.
Nov 19 15:11:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] [instance: e1cdee34-ff81-4ed0-9d71-d27c027f5b5d] Deleting volume: 0eca6d1c-fc56-4860-9a5c-981aa1fd5a44 {{(pid=74934) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 19 15:11:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:54 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:11:54 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:11:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:54 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Deleted allocations for instance e1cdee34-ff81-4ed0-9d71-d27c027f5b5d
Nov 19 15:11:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-9b9333d8-f9da-49d1-86c8-3cf8ca1fcc8f tempest-ServerActionsV293TestJSON-1088824296 tempest-ServerActionsV293TestJSON-1088824296-project-member] Lock "e1cdee34-ff81-4ed0-9d71-d27c027f5b5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.643s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] No waiting events found dispatching network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:11:55 user nova-compute[74934]: WARNING nova.compute.manager [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received unexpected event network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba for instance with vm_state building and task_state spawning.
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.compute.manager [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] No waiting events found dispatching network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:11:55 user nova-compute[74934]: WARNING nova.compute.manager [req-97a05b02-13b2-4cd4-a493-aad01417f2ff req-e33bd744-2fc8-4ef6-9191-cf6fe32434a0 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received unexpected event network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba for instance with vm_state building and task_state spawning.
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:11:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Instance spawned successfully.
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:11:55 user nova-compute[74934]: INFO nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 19 15:11:55 user nova-compute[74934]: DEBUG nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:11:55 user nova-compute[74934]: INFO nova.compute.manager [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Took 20.70 seconds to build instance.
Nov 19 15:11:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-89f69944-125c-46e3-a450-2cc1baa03836 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.797s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:11:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:11:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:12:07 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:12:07 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=25.129009246826172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance dedb3c16-b4a4-4533-b0de-97f218d229ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance d9f0a9a8-e57a-4cec-8477-0d7af9395da0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:12:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating instance_info_cache with network_info: [{"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-changed-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Refreshing instance network info cache due to event network-changed-bba96a48-ec95-4fec-bb63-1c684306ef25. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] Acquiring lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] Acquired lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Refreshing network info cache for port bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updated VIF entry in instance network info cache for port bba96a48-ec95-4fec-bb63-1c684306ef25. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG nova.network.neutron [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating instance_info_cache with network_info: [{"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:12:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-756ccfa4-910a-4249-86d2-ff047ecd4215 req-d4528f65-bfdb-4fed-acb2-12c87a88fa75 service nova] Releasing lock "refresh_cache-d3bc7763-2e66-424b-a60e-35f1134f5dc6" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lazy-loading 'flavor' on Instance uuid d3bc7763-2e66-424b-a60e-35f1134f5dc6 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:15 user nova-compute[74934]: INFO nova.compute.manager [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Attaching volume 8fc9542f-8fee-4d36-8fbc-d25bdcda454a to /dev/vdb
Nov 19 15:12:15 user nova-compute[74934]: DEBUG os_brick.utils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ee4c5-bdbb-42ec-8876-9b7d86d91e10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf878447-3eea-491f-9688-a721e8e7b362]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601ea97-5d45-4e90-9e1f-174b609a5f87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699039c-01a1-4e31-afec-2e95b9e55c28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:12:15 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:12:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0195de7-8673-4483-a4d1-7505ba408f59]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG os_brick.utils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating existing volume attachment record: c09258e8-d808-436f-9d2a-84d0b670bb9c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:12:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:12:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuZAHgVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:12:20 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:12:20 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:12:20 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136d648-150c-4efa-ab5b-6297c126a72f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:12:20 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3624e-2aed-4b77-a9b6-45515f5201a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a] added
Nov 19 15:12:20 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[64942bf9-1f78-4864-9010-4066b00f99ff]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68e3dd7-c1a8-4b25-9c75-b6473fc07ddd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuZAHgVT {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EuZAHgVT" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6765774-ae85-4fa0-a781-af190f0103e2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EuZAHgVT'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[44258170-d672-4043-9635-51a3f85357f8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab72d54-2b15-4396-9c29-722afe723b33]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bb7c9f-8131-46ff-849e-5c252c3127a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260]
Nov 19 15:12:21 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260] successful.
Nov 19 15:12:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f2523-6335-417f-85b5-6bbe5ba03d4f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38422a2-bf17-4cfd-8fee-62b546771407]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a (non-flash)
Nov 19 15:12:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:12:21 user nova-compute[74934]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a (non-flash)
Nov 19 15:12:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9e31e-c07d-4700-800c-86968eef7c8f]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuZAHgVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:12:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23935313634656234', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935313634656234', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG nova.objects.instance [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lazy-loading 'flavor' on Instance uuid d3bc7763-2e66-424b-a60e-35f1134f5dc6 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:12:22 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:12:22 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:12:22 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:12:22 user nova-compute[74934]:   <serial>8fc9542f-8fee-4d36-8fbc-d25bdcda454a</serial>
Nov 19 15:12:22 user nova-compute[74934]: </disk>
Nov 19 15:12:22 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] No VIF found with MAC fa:16:3e:32:28:e4, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:12:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-91152a75-8018-42ae-bd6c-fb81c5c64161 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.402s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:24 user nova-compute[74934]: INFO nova.compute.manager [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Detaching volume 8fc9542f-8fee-4d36-8fbc-d25bdcda454a
Nov 19 15:12:24 user nova-compute[74934]: INFO nova.virt.block_device [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Attempting to driver detach volume 8fc9542f-8fee-4d36-8fbc-d25bdcda454a from mountpoint /dev/vdb
Nov 19 15:12:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Attempting to detach device vdb from instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:12:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:12:24 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:12:24 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:12:24 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:12:24 user nova-compute[74934]:   <serial>8fc9542f-8fee-4d36-8fbc-d25bdcda454a</serial>
Nov 19 15:12:24 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:12:24 user nova-compute[74934]: </disk>
Nov 19 15:12:24 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:12:24 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Successfully detached device vdb from instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 from the persistent domain config.
Nov 19 15:12:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:12:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:12:24 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:12:24 user nova-compute[74934]:   <source dev="/dev/sdc"/>
Nov 19 15:12:24 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:12:24 user nova-compute[74934]:   <serial>8fc9542f-8fee-4d36-8fbc-d25bdcda454a</serial>
Nov 19 15:12:24 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:12:24 user nova-compute[74934]: </disk>
Nov 19 15:12:24 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:12:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:12:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:12:29 user nova-compute[74934]: INFO nova.compute.claims [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Claim successful on node user
Nov 19 15:12:29 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:12:29 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:12:30 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.policy [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af4ac7e0af2f4e8a9178d13c163127ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5267083f3a3a47e0879531209fbf41c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:12:30 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Creating image(s)
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "/opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "/opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "/opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk 1073741824" returned: 0 in 0.055s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Successfully created port: 85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.186s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Cannot resize image /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Ensure instance console log exists: /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Successfully updated port: 85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquired lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-changed-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.compute.manager [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Refreshing instance network info cache due to event network-changed-85cae254-0a31-46a2-8024-497b09a83744. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] Acquiring lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.neutron [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updating instance_info_cache with network_info: [{"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Releasing lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Instance network_info: |[{"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] Acquired lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.neutron [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Refreshing network info cache for port 85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Start _get_guest_xml network_info=[{"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:12:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:12:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-778265044',display_name='tempest-VolumesSnapshotTestJSON-instance-778265044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-778265044',id=47,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq81PgWjXpgLhvzczocai4rCu2Ssh9TIWi4xLb2hs6krLOlY8xjYdHqMwwx9nzd2XYZXG0rAsK3JlZE7ylHO2dgsMcvAARQPUQqHS5L/m8qiywxdinM4OKFXVdLgv5UDg==',key_name='tempest-keypair-1737574127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5267083f3a3a47e0879531209fbf41c4',ramdisk_id='',reservation_id='r-uqhgv7sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1690859431',owner_user_name='tempest-VolumesSnapshotTestJSON-1690859431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:12:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af4ac7e0af2f4e8a9178d13c163127ce',uuid=00dcefc8-8b25-4957-ad29-3ff5c6672510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converting VIF {"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'pci_devices' on Instance uuid 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:12:31 user nova-compute[74934]:   <uuid>00dcefc8-8b25-4957-ad29-3ff5c6672510</uuid>
Nov 19 15:12:31 user nova-compute[74934]:   <name>instance-0000002f</name>
Nov 19 15:12:31 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:12:31 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:12:31 user nova-compute[74934]:   <metadata>
Nov 19 15:12:31 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:12:31 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:12:31 user nova-compute[74934]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-778265044</nova:name>
Nov 19 15:12:31 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:12:31</nova:creationTime>
Nov 19 15:12:31 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:12:31 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:12:31 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:12:31 user nova-compute[74934]:       <nova:owner>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:user uuid="af4ac7e0af2f4e8a9178d13c163127ce">tempest-VolumesSnapshotTestJSON-1690859431-project-member</nova:user>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:project uuid="5267083f3a3a47e0879531209fbf41c4">tempest-VolumesSnapshotTestJSON-1690859431</nova:project>
Nov 19 15:12:31 user nova-compute[74934]:       </nova:owner>
Nov 19 15:12:31 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:12:31 user nova-compute[74934]:       <nova:ports>
Nov 19 15:12:31 user nova-compute[74934]:         <nova:port uuid="85cae254-0a31-46a2-8024-497b09a83744">
Nov 19 15:12:31 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 19 15:12:31 user nova-compute[74934]:         </nova:port>
Nov 19 15:12:31 user nova-compute[74934]:       </nova:ports>
Nov 19 15:12:31 user nova-compute[74934]:     </nova:instance>
Nov 19 15:12:31 user nova-compute[74934]:   </metadata>
Nov 19 15:12:31 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:12:31 user nova-compute[74934]:     <system>
Nov 19 15:12:31 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:12:31 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:12:31 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:12:31 user nova-compute[74934]:       <entry name="serial">00dcefc8-8b25-4957-ad29-3ff5c6672510</entry>
Nov 19 15:12:31 user nova-compute[74934]:       <entry name="uuid">00dcefc8-8b25-4957-ad29-3ff5c6672510</entry>
Nov 19 15:12:31 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:12:31 user nova-compute[74934]:     </system>
Nov 19 15:12:31 user nova-compute[74934]:   </sysinfo>
Nov 19 15:12:31 user nova-compute[74934]:   <os>
Nov 19 15:12:31 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:12:31 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:12:31 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:12:31 user nova-compute[74934]:   </os>
Nov 19 15:12:31 user nova-compute[74934]:   <features>
Nov 19 15:12:31 user nova-compute[74934]:     <acpi/>
Nov 19 15:12:31 user nova-compute[74934]:     <apic/>
Nov 19 15:12:31 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:12:31 user nova-compute[74934]:   </features>
Nov 19 15:12:31 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:12:31 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:12:31 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:12:31 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:12:31 user nova-compute[74934]:   </clock>
Nov 19 15:12:31 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:12:31 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:12:31 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:12:31 user nova-compute[74934]:   </cpu>
Nov 19 15:12:31 user nova-compute[74934]:   <devices>
Nov 19 15:12:31 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:12:31 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:12:31 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk"/>
Nov 19 15:12:31 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:12:31 user nova-compute[74934]:     </disk>
Nov 19 15:12:31 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:12:31 user nova-compute[74934]:       <mac address="fa:16:3e:c5:57:fe"/>
Nov 19 15:12:31 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:12:31 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:12:31 user nova-compute[74934]:       <target dev="tap85cae254-0a"/>
Nov 19 15:12:31 user nova-compute[74934]:     </interface>
Nov 19 15:12:31 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:12:31 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/console.log" append="off"/>
Nov 19 15:12:31 user nova-compute[74934]:     </serial>
Nov 19 15:12:31 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:12:31 user nova-compute[74934]:     <video>
Nov 19 15:12:31 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:12:31 user nova-compute[74934]:     </video>
Nov 19 15:12:31 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:12:31 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:12:31 user nova-compute[74934]:     </rng>
Nov 19 15:12:31 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:12:31 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:12:31 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:12:31 user nova-compute[74934]:     </memballoon>
Nov 19 15:12:31 user nova-compute[74934]:   </devices>
Nov 19 15:12:31 user nova-compute[74934]: </domain>
Nov 19 15:12:31 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-778265044',display_name='tempest-VolumesSnapshotTestJSON-instance-778265044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-778265044',id=47,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq81PgWjXpgLhvzczocai4rCu2Ssh9TIWi4xLb2hs6krLOlY8xjYdHqMwwx9nzd2XYZXG0rAsK3JlZE7ylHO2dgsMcvAARQPUQqHS5L/m8qiywxdinM4OKFXVdLgv5UDg==',key_name='tempest-keypair-1737574127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5267083f3a3a47e0879531209fbf41c4',ramdisk_id='',reservation_id='r-uqhgv7sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1690859431',owner_user_name='tempest-VolumesSnapshotTestJSON-1690859431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:12:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af4ac7e0af2f4e8a9178d13c163127ce',uuid=00dcefc8-8b25-4957-ad29-3ff5c6672510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converting VIF {"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG os_vif [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '549c86c9-35d8-5e56-9d18-a21d66956316', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85cae254-0a, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85cae254-0a, col_values=(('qos', UUID('fbd7045d-6da0-4fd6-bd1e-de9b2754e692')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85cae254-0a, col_values=(('external_ids', {'iface-id': '85cae254-0a31-46a2-8024-497b09a83744', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:57:fe', 'vm-uuid': '00dcefc8-8b25-4957-ad29-3ff5c6672510'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:12:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:31 user nova-compute[74934]: INFO os_vif [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a')
Nov 19 15:12:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:12:32 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No VIF found with MAC fa:16:3e:c5:57:fe, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:12:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updated VIF entry in instance network info cache for port 85cae254-0a31-46a2-8024-497b09a83744. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:12:32 user nova-compute[74934]: DEBUG nova.network.neutron [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updating instance_info_cache with network_info: [{"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:12:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-937b1caf-80ed-4162-ad9b-f27bd5f5035d req-a54d8bee-346f-4ec6-b4ec-1f5f20c6cb2a service nova] Releasing lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-d9d7021e-0088-40a6-a199-0b4bbbf230d7 req-443254f6-2f66-4485-8204-e6b7004a14a6 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9d7021e-0088-40a6-a199-0b4bbbf230d7 req-443254f6-2f66-4485-8204-e6b7004a14a6 service nova] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9d7021e-0088-40a6-a199-0b4bbbf230d7 req-443254f6-2f66-4485-8204-e6b7004a14a6 service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d9d7021e-0088-40a6-a199-0b4bbbf230d7 req-443254f6-2f66-4485-8204-e6b7004a14a6 service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG nova.compute.manager [req-d9d7021e-0088-40a6-a199-0b4bbbf230d7 req-443254f6-2f66-4485-8204-e6b7004a14a6 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] No waiting events found dispatching network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:12:33 user nova-compute[74934]: WARNING nova.compute.manager [req-d9d7021e-0088-40a6-a199-0b4bbbf230d7 req-443254f6-2f66-4485-8204-e6b7004a14a6 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received unexpected event network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 for instance with vm_state building and task_state spawning.
Nov 19 15:12:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:12:35 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Instance spawned successfully.
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:12:35 user nova-compute[74934]: INFO nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:12:35 user nova-compute[74934]: INFO nova.compute.manager [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Took 5.85 seconds to build instance.
Nov 19 15:12:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2ac6b14d-46e2-4340-8c5e-75d219fa3bcf tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.933s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-783e623f-cd7b-4722-a4b1-d6f461ec2d16 req-ef03007a-5d38-4aa4-9e4a-17a0f277d064 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-783e623f-cd7b-4722-a4b1-d6f461ec2d16 req-ef03007a-5d38-4aa4-9e4a-17a0f277d064 service nova] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-783e623f-cd7b-4722-a4b1-d6f461ec2d16 req-ef03007a-5d38-4aa4-9e4a-17a0f277d064 service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-783e623f-cd7b-4722-a4b1-d6f461ec2d16 req-ef03007a-5d38-4aa4-9e4a-17a0f277d064 service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:35 user nova-compute[74934]: DEBUG nova.compute.manager [req-783e623f-cd7b-4722-a4b1-d6f461ec2d16 req-ef03007a-5d38-4aa4-9e4a-17a0f277d064 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] No waiting events found dispatching network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:12:35 user nova-compute[74934]: WARNING nova.compute.manager [req-783e623f-cd7b-4722-a4b1-d6f461ec2d16 req-ef03007a-5d38-4aa4-9e4a-17a0f277d064 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received unexpected event network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 for instance with vm_state active and task_state None.
Nov 19 15:12:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:12:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:12:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:12:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:12:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:44 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 is timed out.
Nov 19 15:12:44 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Successfully detached device vdb from instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 from the live domain config.
Nov 19 15:12:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EuZAHgVT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:12:44 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dedf96-6988-4675-a89c-898e2e24559d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:12:44 user nova-compute[74934]: No targets found.
Nov 19 15:12:44 user nova-compute[74934]: iSNS:
Nov 19 15:12:44 user nova-compute[74934]: No targets found.
Nov 19 15:12:44 user nova-compute[74934]: STATIC:
Nov 19 15:12:44 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1
Nov 19 15:12:44 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:12:44 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:12:44 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3
Nov 19 15:12:44 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:12:44 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:12:44 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a
Nov 19 15:12:44 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:12:44 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:12:44 user nova-compute[74934]: FIRMWARE:
Nov 19 15:12:44 user nova-compute[74934]: No targets found.
Nov 19 15:12:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:12:44 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:12:44 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe659ec-e2d1-4a68-a53c-53783ccffabc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e0e51-e220-48b4-a414-65979efa4c17]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:12:44 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:12:44 user nova-compute[74934]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a (non-flash)
Nov 19 15:12:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:12:44 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:12:44 user nova-compute[74934]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a (non-flash)
Nov 19 15:12:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a40acb-409a-43c6-a913-276accb09df7]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5887c3-a701-4484-bb8b-3f440eac0d9c]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[845fb7b8-bb10-4faa-a30a-0081f38762e6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e54e5-1207-4c75-a37a-af25757c7cd3]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fb6fcf-1e83-411f-a1f5-4739c9c6d238]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436761c-fe6a-4c43-a3b9-6fa1fb0d534f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260]
Nov 19 15:12:44 user nova-compute[74934]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a, portal: 172.16.0.220,3260] successful.
Nov 19 15:12:44 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fc9542f-8fee-4d36-8fbc-d25bdcda454a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5151f36b-e688-4b4e-a98d-02833dfec5e6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] <== disconnect_volume: return (311ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:12:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:12:45 user nova-compute[74934]: DEBUG nova.objects.instance [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lazy-loading 'flavor' on Instance uuid d3bc7763-2e66-424b-a60e-35f1134f5dc6 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:12:45 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-52a544bf-d74b-4fdc-9b3c-b90208cee486 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:12:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:12:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:00 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:06 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:13:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:13:09 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=25.08873748779297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance dedb3c16-b4a4-4533-b0de-97f218d229ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance d9f0a9a8-e57a-4cec-8477-0d7af9395da0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:13:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:13:10 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:13:10 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:13:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:13:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:13:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:13:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:16 user nova-compute[74934]: INFO nova.compute.manager [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Terminating instance
Nov 19 15:13:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-9fd79238-16c0-48e3-988d-34f0da8da84b req-c4b5bf90-f51b-4d02-9777-21374d1d1865 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-vif-unplugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9fd79238-16c0-48e3-988d-34f0da8da84b req-c4b5bf90-f51b-4d02-9777-21374d1d1865 service nova] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9fd79238-16c0-48e3-988d-34f0da8da84b req-c4b5bf90-f51b-4d02-9777-21374d1d1865 service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9fd79238-16c0-48e3-988d-34f0da8da84b req-c4b5bf90-f51b-4d02-9777-21374d1d1865 service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-9fd79238-16c0-48e3-988d-34f0da8da84b req-c4b5bf90-f51b-4d02-9777-21374d1d1865 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] No waiting events found dispatching network-vif-unplugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-9fd79238-16c0-48e3-988d-34f0da8da84b req-c4b5bf90-f51b-4d02-9777-21374d1d1865 service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-vif-unplugged-bba96a48-ec95-4fec-bb63-1c684306ef25 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:13:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Instance destroyed successfully.
Nov 19 15:13:17 user nova-compute[74934]: DEBUG nova.objects.instance [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lazy-loading 'resources' on Instance uuid d3bc7763-2e66-424b-a60e-35f1134f5dc6 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:10:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-912789150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9127891',id=45,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDztRitpipyFx9zYNLm3gGUmj6HGWQjmjgqoIwwcAJ6vmh/otLIgkvyU3a3Uwj0QP/I8H0JSbSZd+2m9p+QJAl37w6o3QN30X+gLMy5g7EeWRLlKvD8W1szHJPn/aCwDyQ==',key_name='tempest-keypair-1853409064',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:10:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='647a07100dee4a149493e8ada494a7c0',ramdisk_id='',reservation_id='r-zcs8xwwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-816509203',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f86f10cdf0464797a6ba95a09733e72e',uuid=d3bc7763-2e66-424b-a60e-35f1134f5dc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Converting VIF {"id": "bba96a48-ec95-4fec-bb63-1c684306ef25", "address": "fa:16:3e:32:28:e4", "network": {"id": "7d3b63d5-25fb-481b-8c12-d25f660b3ac7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1274331452-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a07100dee4a149493e8ada494a7c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba96a48-ec", "ovs_interfaceid": "bba96a48-ec95-4fec-bb63-1c684306ef25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG os_vif [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbba96a48-ec, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c2f5deb-5d56-4937-a541-cc526bdd0968) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:17 user nova-compute[74934]: INFO os_vif [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:28:e4,bridge_name='br-int',has_traffic_filtering=True,id=bba96a48-ec95-4fec-bb63-1c684306ef25,network=Network(7d3b63d5-25fb-481b-8c12-d25f660b3ac7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba96a48-ec')
Nov 19 15:13:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Deleting instance files /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6_del
Nov 19 15:13:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Deletion of /opt/stack/data/nova/instances/d3bc7763-2e66-424b-a60e-35f1134f5dc6_del complete
Nov 19 15:13:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:17 user nova-compute[74934]: INFO nova.compute.manager [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 19 15:13:17 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:13:17 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:13:18 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Took 0.89 seconds to deallocate network for instance.
Nov 19 15:13:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-1534f901-c924-4d23-8d06-ea01577bf0c7 req-f5b79e3a-569f-4ae9-ae45-66bec7b8ffce service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-vif-deleted-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:18 user nova-compute[74934]: INFO nova.compute.manager [req-1534f901-c924-4d23-8d06-ea01577bf0c7 req-f5b79e3a-569f-4ae9-ae45-66bec7b8ffce service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Neutron deleted interface bba96a48-ec95-4fec-bb63-1c684306ef25; detaching it from the instance and deleting it from the info cache
Nov 19 15:13:18 user nova-compute[74934]: DEBUG nova.network.neutron [req-1534f901-c924-4d23-8d06-ea01577bf0c7 req-f5b79e3a-569f-4ae9-ae45-66bec7b8ffce service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG nova.compute.manager [req-1534f901-c924-4d23-8d06-ea01577bf0c7 req-f5b79e3a-569f-4ae9-ae45-66bec7b8ffce service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Detach interface failed, port_id=bba96a48-ec95-4fec-bb63-1c684306ef25, reason: Instance d3bc7763-2e66-424b-a60e-35f1134f5dc6 could not be found. {{(pid=74934) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:13:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:18 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Deleted allocations for instance d3bc7763-2e66-424b-a60e-35f1134f5dc6
Nov 19 15:13:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-248b68db-b3f3-4bae-8485-c00f4c48acd5 tempest-TestServerVolumeAttachScenarioOldVersion-816509203 tempest-TestServerVolumeAttachScenarioOldVersion-816509203-project-member] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-5f3e9dc2-778a-43b6-9e53-b2e5f9cc4d72 req-6c8e7ee1-f0ba-46bc-9ca0-52ace789545b service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received event network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5f3e9dc2-778a-43b6-9e53-b2e5f9cc4d72 req-6c8e7ee1-f0ba-46bc-9ca0-52ace789545b service nova] Acquiring lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5f3e9dc2-778a-43b6-9e53-b2e5f9cc4d72 req-6c8e7ee1-f0ba-46bc-9ca0-52ace789545b service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5f3e9dc2-778a-43b6-9e53-b2e5f9cc4d72 req-6c8e7ee1-f0ba-46bc-9ca0-52ace789545b service nova] Lock "d3bc7763-2e66-424b-a60e-35f1134f5dc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-5f3e9dc2-778a-43b6-9e53-b2e5f9cc4d72 req-6c8e7ee1-f0ba-46bc-9ca0-52ace789545b service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] No waiting events found dispatching network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:13:19 user nova-compute[74934]: WARNING nova.compute.manager [req-5f3e9dc2-778a-43b6-9e53-b2e5f9cc4d72 req-6c8e7ee1-f0ba-46bc-9ca0-52ace789545b service nova] [instance: d3bc7763-2e66-424b-a60e-35f1134f5dc6] Received unexpected event network-vif-plugged-bba96a48-ec95-4fec-bb63-1c684306ef25 for instance with vm_state deleted and task_state None.
Nov 19 15:13:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-changed-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:25 user nova-compute[74934]: DEBUG nova.compute.manager [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Refreshing instance network info cache due to event network-changed-274d1394-0810-439c-a162-155bffb323ba. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:13:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] Acquiring lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:13:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] Acquired lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:13:25 user nova-compute[74934]: DEBUG nova.network.neutron [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Refreshing network info cache for port 274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:13:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updated VIF entry in instance network info cache for port 274d1394-0810-439c-a162-155bffb323ba. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.network.neutron [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updating instance_info_cache with network_info: [{"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a8b8b4de-9ef2-41e1-8ba0-c718578ae51c req-162667f4-9917-4875-8749-702eff62236f service nova] Releasing lock "refresh_cache-d9f0a9a8-e57a-4cec-8477-0d7af9395da0" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:26 user nova-compute[74934]: INFO nova.compute.manager [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Terminating instance
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-0787bf03-6833-4457-9acc-264bea3c9796 req-15e692d1-7c60-40ab-bfa6-5b79fd605dca service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-vif-unplugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0787bf03-6833-4457-9acc-264bea3c9796 req-15e692d1-7c60-40ab-bfa6-5b79fd605dca service nova] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0787bf03-6833-4457-9acc-264bea3c9796 req-15e692d1-7c60-40ab-bfa6-5b79fd605dca service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0787bf03-6833-4457-9acc-264bea3c9796 req-15e692d1-7c60-40ab-bfa6-5b79fd605dca service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-0787bf03-6833-4457-9acc-264bea3c9796 req-15e692d1-7c60-40ab-bfa6-5b79fd605dca service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] No waiting events found dispatching network-vif-unplugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-0787bf03-6833-4457-9acc-264bea3c9796 req-15e692d1-7c60-40ab-bfa6-5b79fd605dca service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-vif-unplugged-274d1394-0810-439c-a162-155bffb323ba for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Instance destroyed successfully.
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'resources' on Instance uuid d9f0a9a8-e57a-4cec-8477-0d7af9395da0 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1121508690',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1121508690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1121508690',id=46,image_ref='5d6bfc93-a68c-4b9c-bcaf-c59621253207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDtFbudqK/TwFy74VMqtrWVoJFPaEzvHjaM11hd9r3eFMDrotJ9A1OG9bpfFflfiDEj+L1yjZcXepiF7Zq9YUxAUi0FCxhM/91wILMOWthCkLTkjgxyr/bSh4LFVj0D6g==',key_name='tempest-keypair-646976785',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-w8fjizpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-686579107',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ade11c889684ca9b402fa1066e4b629',uuid=d9f0a9a8-e57a-4cec-8477-0d7af9395da0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "274d1394-0810-439c-a162-155bffb323ba", "address": "fa:16:3e:8b:82:73", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap274d1394-08", "ovs_interfaceid": "274d1394-0810-439c-a162-155bffb323ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_vif [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap274d1394-08, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29e278cc-c3e1-44d5-afee-5f6a4b3442a1) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:26 user nova-compute[74934]: INFO os_vif [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:82:73,bridge_name='br-int',has_traffic_filtering=True,id=274d1394-0810-439c-a162-155bffb323ba,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap274d1394-08')
Nov 19 15:13:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdRaeMJV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:13:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[849fa395-df6d-408e-bc41-41bf4e8ba920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:13:26 user nova-compute[74934]: No targets found.
Nov 19 15:13:26 user nova-compute[74934]: iSNS:
Nov 19 15:13:26 user nova-compute[74934]: No targets found.
Nov 19 15:13:26 user nova-compute[74934]: STATIC:
Nov 19 15:13:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1
Nov 19 15:13:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:13:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:13:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3
Nov 19 15:13:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:13:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:13:26 user nova-compute[74934]: FIRMWARE:
Nov 19 15:13:26 user nova-compute[74934]: No targets found.
Nov 19 15:13:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:13:26 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:13:26 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882cd15-687f-4c29-828d-e18b012b6586]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9808c8e2-d1f1-436f-920d-cb30b3295a89]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:13:26 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:13:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:13:26 user nova-compute[74934]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 (non-flash)
Nov 19 15:13:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3'): ({'sdd'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Removing single pathed devices sdd {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d35998-74a3-4329-9d03-9388cbb50c3e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[207425ae-3dc3-4dd7-97ea-d4ae150cdf1c]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flushing IO for device /dev/sdd {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eece6b2-623c-4e81-af01-b41fc4315d31]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a906f33-3b9e-4ca5-ba58-6081021f7afd]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] SCSI volumes sdd have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e72de-108b-40af-85f0-d2ea7990ff19]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bdc1af-9133-45e7-aad8-a38245d2190c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260]
Nov 19 15:13:27 user nova-compute[74934]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3, portal: 172.16.0.220,3260] successful.
Nov 19 15:13:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cacecfa1-546b-4d27-9102-33e0a38056a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[184c4abe-9c71-4f89-a9a9-7b1439395cb5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== disconnect_volume: return (299ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:13:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Deleting instance files /opt/stack/data/nova/instances/d9f0a9a8-e57a-4cec-8477-0d7af9395da0_del
Nov 19 15:13:27 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Deletion of /opt/stack/data/nova/instances/d9f0a9a8-e57a-4cec-8477-0d7af9395da0_del complete
Nov 19 15:13:27 user nova-compute[74934]: INFO nova.compute.manager [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 19 15:13:27 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:13:27 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:13:28 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Took 0.78 seconds to deallocate network for instance.
Nov 19 15:13:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] Acquiring lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] No waiting events found dispatching network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:13:28 user nova-compute[74934]: WARNING nova.compute.manager [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received unexpected event network-vif-plugged-274d1394-0810-439c-a162-155bffb323ba for instance with vm_state active and task_state deleting.
Nov 19 15:13:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-0bd947da-abb1-4413-9629-af59cddea663 req-68f0ab45-157c-45a2-a3f3-43d6e9416511 service nova] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Received event network-vif-deleted-274d1394-0810-439c-a162-155bffb323ba {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:13:28 user nova-compute[74934]: INFO nova.compute.manager [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Took 0.75 seconds to detach 1 volumes for instance.
Nov 19 15:13:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: d9f0a9a8-e57a-4cec-8477-0d7af9395da0] Deleting volume: cacecfa1-546b-4d27-9102-33e0a38056a3 {{(pid=74934) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:13:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:13:29 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:13:29 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:13:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:29 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Deleted allocations for instance d9f0a9a8-e57a-4cec-8477-0d7af9395da0
Nov 19 15:13:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-da6ad6c4-7377-4277-9bad-b08883f59083 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "d9f0a9a8-e57a-4cec-8477-0d7af9395da0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:13:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:13:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:13:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:13:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:13:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:13:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:01 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:08 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:09 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:10 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:14:10 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=25.115337371826172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance dedb3c16-b4a4-4533-b0de-97f218d229ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:14:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid dedb3c16-b4a4-4533-b0de-97f218d229ea {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating instance_info_cache with network_info: [{"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-dedb3c16-b4a4-4533-b0de-97f218d229ea" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:14:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:18 user nova-compute[74934]: INFO nova.compute.manager [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Terminating instance
Nov 19 15:14:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-cd2bfaed-999c-468b-9c0b-27b55bf0a9b0 req-3413d77b-191c-45fa-a0ea-9084b4d29bf9 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-vif-unplugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cd2bfaed-999c-468b-9c0b-27b55bf0a9b0 req-3413d77b-191c-45fa-a0ea-9084b4d29bf9 service nova] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cd2bfaed-999c-468b-9c0b-27b55bf0a9b0 req-3413d77b-191c-45fa-a0ea-9084b4d29bf9 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-cd2bfaed-999c-468b-9c0b-27b55bf0a9b0 req-3413d77b-191c-45fa-a0ea-9084b4d29bf9 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-cd2bfaed-999c-468b-9c0b-27b55bf0a9b0 req-3413d77b-191c-45fa-a0ea-9084b4d29bf9 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] No waiting events found dispatching network-vif-unplugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-cd2bfaed-999c-468b-9c0b-27b55bf0a9b0 req-3413d77b-191c-45fa-a0ea-9084b4d29bf9 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-vif-unplugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:14:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Instance destroyed successfully.
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.objects.instance [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'resources' on Instance uuid dedb3c16-b4a4-4533-b0de-97f218d229ea {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:09:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1621285312',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1621285312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1621285312',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVyvXjdFnqP+x8/UFOsL/nPs93MwOdbg3hsEp/Syl10xzD4wMCgPFmtF12kf82y+6e4z+lK3DdSCfD/525/Qsathjg4SUi2NJ6dSPl/LJNAvZRi8utCRbMNiQKzDwLCIw==',key_name='tempest-keypair-573577072',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-vy63qo6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:09:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ade11c889684ca9b402fa1066e4b629',uuid=dedb3c16-b4a4-4533-b0de-97f218d229ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "address": "fa:16:3e:dd:d7:c8", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58fd1e88-8d", "ovs_interfaceid": "58fd1e88-8d8a-42cf-9b6f-2580461947e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_vif [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58fd1e88-8d, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=492b9f74-17e6-4313-b4a7-1d416f3cd199) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:14:19 user nova-compute[74934]: INFO os_vif [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:d7:c8,bridge_name='br-int',has_traffic_filtering=True,id=58fd1e88-8d8a-42cf-9b6f-2580461947e1,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58fd1e88-8d')
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diEjrNuw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:14:19 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3087920d-8d6f-4603-98e7-1f98442ff246]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:14:19 user nova-compute[74934]: No targets found.
Nov 19 15:14:19 user nova-compute[74934]: iSNS:
Nov 19 15:14:19 user nova-compute[74934]: No targets found.
Nov 19 15:14:19 user nova-compute[74934]: STATIC:
Nov 19 15:14:19 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1
Nov 19 15:14:19 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:14:19 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:14:19 user nova-compute[74934]: FIRMWARE:
Nov 19 15:14:19 user nova-compute[74934]: No targets found.
Nov 19 15:14:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:14:19 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:14:19 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a318dab-f235-4672-9934-338a2c63a32c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[17029c68-0bf7-4125-97f2-354b8906f061]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:14:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 (non-flash)
Nov 19 15:14:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6de5428-d151-435b-ab0d-916f272f0239]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe4936a-2e9b-4eac-9413-9ef6335a9865]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a54b03-d435-4041-a294-715a2bbb5421]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d325d17a-0a3c-4fdc-8785-f01757d8f472]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6e7f4414', '/dev/disk/by-id/scsi-23631383937623134', '/dev/disk/by-id/scsi-1SCST_BIO6e7f4414-61897b14f3263478') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b7bc6-37de-47bf-b6f6-a9ad99c29827]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649a8c4-08d3-414e-8570-ae40feece171]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e69bba-02a6-484b-b5f3-3ce0028b4cdd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260]
Nov 19 15:14:19 user nova-compute[74934]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1, portal: 172.16.0.220,3260] successful.
Nov 19 15:14:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:815b1e9a-3380-490e-85ee-f20871af21b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e3a2f-7c75-4772-8505-b80f8347fd06]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== disconnect_volume: return (301ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:14:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Deleting instance files /opt/stack/data/nova/instances/dedb3c16-b4a4-4533-b0de-97f218d229ea_del
Nov 19 15:14:19 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Deletion of /opt/stack/data/nova/instances/dedb3c16-b4a4-4533-b0de-97f218d229ea_del complete
Nov 19 15:14:19 user nova-compute[74934]: INFO nova.compute.manager [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 19 15:14:19 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:14:19 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:14:20 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:14:20 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Took 0.89 seconds to deallocate network for instance.
Nov 19 15:14:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-cff26993-ce41-4de4-9fbb-171c937d69be req-db780813-bddf-485c-be19-ab9f560e80a5 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-vif-deleted-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:14:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:20 user nova-compute[74934]: DEBUG nova.objects.instance [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'flavor' on Instance uuid 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:14:20 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Ignoring supplied device name: /dev/vdb
Nov 19 15:14:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:21 user nova-compute[74934]: INFO nova.compute.manager [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Attaching volume afb1091b-c1f9-4e22-ae7f-026ef0d3602f to /dev/vdb
Nov 19 15:14:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received event network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] Acquiring lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] No waiting events found dispatching network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:14:21 user nova-compute[74934]: WARNING nova.compute.manager [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Received unexpected event network-vif-plugged-58fd1e88-8d8a-42cf-9b6f-2580461947e1 for instance with vm_state active and task_state deleting.
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-changed-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Refreshing instance network info cache due to event network-changed-85cae254-0a31-46a2-8024-497b09a83744. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] Acquiring lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] Acquired lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Refreshing network info cache for port 85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG os_brick.utils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[107efb69-e349-4ed6-b368-4ca63d32cea9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[44429ef6-5940-4adf-a75f-caae8bbdb30f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba03d68-5500-43ab-9064-3ed2b04b0a05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab4e79-d5de-41a3-8814-e3278dacdb7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:14:21 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf570b5-9b8c-49ea-8b6f-77a8bfb35867]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG os_brick.utils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updating existing volume attachment record: 68e325f6-40bd-4901-8dd9-f69ecdaf4465 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:14:21 user nova-compute[74934]: INFO nova.compute.manager [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Took 0.78 seconds to detach 1 volumes for instance.
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: dedb3c16-b4a4-4533-b0de-97f218d229ea] Deleting volume: 815b1e9a-3380-490e-85ee-f20871af21b1 {{(pid=74934) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updated VIF entry in instance network info cache for port 85cae254-0a31-46a2-8024-497b09a83744. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.network.neutron [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updating instance_info_cache with network_info: [{"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f3b583f-3329-4d64-a377-5fdb17d88c87 req-20a10abe-8f66-4b78-9117-3be1e739d919 service nova] Releasing lock "refresh_cache-00dcefc8-8b25-4957-ad29-3ff5c6672510" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:21 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Deleted allocations for instance dedb3c16-b4a4-4533-b0de-97f218d229ea
Nov 19 15:14:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0a2944e6-7960-4262-b3f0-6a4c7a24a5f2 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "dedb3c16-b4a4-4533-b0de-97f218d229ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:14:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrdUbKzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:14:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:14:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:14:26 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[35efd949-2704-48b4-a286-7d6ab8dad15d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:14:26 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f19c61-31fc-45ce-b560-d708fd53ab7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f] added
Nov 19 15:14:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ebe42e-5b5a-4fe4-b219-58016fdf3f42]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[490985dc-853b-41af-a121-1a361854e575]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrdUbKzD {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xrdUbKzD" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5677567-0e90-4d47-bd2a-0d3ad2b21c99]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xrdUbKzD'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9b08b-b22c-4e5d-88bb-4233d4d91225]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e4f1c9-d979-483a-9de0-491c2abda39a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:14:26 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:14:26 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:14:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:14:26 user nova-compute[74934]: 
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4416665-e166-4d4c-9626-31825e7f4353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260]
Nov 19 15:14:26 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260] successful.
Nov 19 15:14:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f594354-db89-484c-b9f0-01948ef25ba5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[823623bc-c43d-4269-bbe9-8e540c9ad219]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f (non-flash)
Nov 19 15:14:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f (non-flash)
Nov 19 15:14:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1483d909-b2b3-4512-81b2-f0b2d6205869]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:14:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrdUbKzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:14:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:14:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23030323739353763', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:14:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030323739353763', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:14:27 user nova-compute[74934]: DEBUG nova.objects.instance [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'flavor' on Instance uuid 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:14:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:14:27 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:14:27 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:14:27 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:14:27 user nova-compute[74934]:   <serial>afb1091b-c1f9-4e22-ae7f-026ef0d3602f</serial>
Nov 19 15:14:27 user nova-compute[74934]: </disk>
Nov 19 15:14:27 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:14:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:14:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:14:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No VIF found with MAC fa:16:3e:c5:57:fe, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:14:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-78ac5193-3745-47e8-b0b4-e7b44458f49b tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.415s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:14:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:14:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:14:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:14:42 user nova-compute[74934]: INFO nova.compute.manager [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Detaching volume afb1091b-c1f9-4e22-ae7f-026ef0d3602f
Nov 19 15:14:42 user nova-compute[74934]: INFO nova.virt.block_device [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Attempting to driver detach volume afb1091b-c1f9-4e22-ae7f-026ef0d3602f from mountpoint /dev/vdb
Nov 19 15:14:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Attempting to detach device vdb from instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:14:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:14:42 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:14:42 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:14:42 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:14:42 user nova-compute[74934]:   <serial>afb1091b-c1f9-4e22-ae7f-026ef0d3602f</serial>
Nov 19 15:14:42 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:14:42 user nova-compute[74934]: </disk>
Nov 19 15:14:42 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:14:42 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully detached device vdb from instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 from the persistent domain config.
Nov 19 15:14:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:14:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:14:42 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:14:42 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:14:42 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:14:42 user nova-compute[74934]:   <serial>afb1091b-c1f9-4e22-ae7f-026ef0d3602f</serial>
Nov 19 15:14:42 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:14:42 user nova-compute[74934]: </disk>
Nov 19 15:14:42 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:14:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:14:42 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:14:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:14:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:14:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:02 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 is timed out.
Nov 19 15:15:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully detached device vdb from instance 00dcefc8-8b25-4957-ad29-3ff5c6672510 from the live domain config.
Nov 19 15:15:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrdUbKzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:15:02 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6347980-08df-4c94-ae73-7a1d95c2b647]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:15:02 user nova-compute[74934]: No targets found.
Nov 19 15:15:02 user nova-compute[74934]: iSNS:
Nov 19 15:15:02 user nova-compute[74934]: No targets found.
Nov 19 15:15:02 user nova-compute[74934]: STATIC:
Nov 19 15:15:02 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f
Nov 19 15:15:02 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:15:02 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:15:02 user nova-compute[74934]: FIRMWARE:
Nov 19 15:15:02 user nova-compute[74934]: No targets found.
Nov 19 15:15:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:15:02 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:15:02 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9b7c94-aacc-4c6d-b631-7569a70953e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa52d1-e9ef-4fe3-836f-0c3a28ae68ae]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f (non-flash)
Nov 19 15:15:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f (non-flash)
Nov 19 15:15:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc0e0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef9aac-db1b-4a45-aa9c-a155aa5caffd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb4211-b9c8-414c-beaf-b55ce12ea778]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc532e6-cf3e-4f00-9f56-64cacd706d17]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecd912b-2301-44fb-869c-3b74ca2585bd]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[62168cd2-1301-427c-b2b7-a58450ddb2e6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc20a9a-3fa8-4429-84c8-48baa0332844]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260]
Nov 19 15:15:02 user nova-compute[74934]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f, portal: 172.16.0.220,3260] successful.
Nov 19 15:15:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a942c39-9ce3-4ee7-9a5d-ebb1c544b3c9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== disconnect_volume: return (299ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:15:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'flavor' on Instance uuid 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fd8847d7-78e4-4b8d-ad18-6fab43ec9e95 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.476s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:03 user nova-compute[74934]: INFO nova.compute.manager [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Terminating instance
Nov 19 15:15:03 user nova-compute[74934]: DEBUG nova.compute.manager [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-98e582e1-4304-4b1e-81e3-c1bfad62dc8d req-69108073-3207-4a97-acda-e8e97aaf0c42 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-vif-unplugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-98e582e1-4304-4b1e-81e3-c1bfad62dc8d req-69108073-3207-4a97-acda-e8e97aaf0c42 service nova] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-98e582e1-4304-4b1e-81e3-c1bfad62dc8d req-69108073-3207-4a97-acda-e8e97aaf0c42 service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-98e582e1-4304-4b1e-81e3-c1bfad62dc8d req-69108073-3207-4a97-acda-e8e97aaf0c42 service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-98e582e1-4304-4b1e-81e3-c1bfad62dc8d req-69108073-3207-4a97-acda-e8e97aaf0c42 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] No waiting events found dispatching network-vif-unplugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:15:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-98e582e1-4304-4b1e-81e3-c1bfad62dc8d req-69108073-3207-4a97-acda-e8e97aaf0c42 service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-vif-unplugged-85cae254-0a31-46a2-8024-497b09a83744 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:04 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Instance destroyed successfully.
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.objects.instance [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'resources' on Instance uuid 00dcefc8-8b25-4957-ad29-3ff5c6672510 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-778265044',display_name='tempest-VolumesSnapshotTestJSON-instance-778265044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-778265044',id=47,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq81PgWjXpgLhvzczocai4rCu2Ssh9TIWi4xLb2hs6krLOlY8xjYdHqMwwx9nzd2XYZXG0rAsK3JlZE7ylHO2dgsMcvAARQPUQqHS5L/m8qiywxdinM4OKFXVdLgv5UDg==',key_name='tempest-keypair-1737574127',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:12:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5267083f3a3a47e0879531209fbf41c4',ramdisk_id='',reservation_id='r-uqhgv7sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1690859431',owner_user_name='tempest-VolumesSnapshotTestJSON-1690859431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af4ac7e0af2f4e8a9178d13c163127ce',uuid=00dcefc8-8b25-4957-ad29-3ff5c6672510,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converting VIF {"id": "85cae254-0a31-46a2-8024-497b09a83744", "address": "fa:16:3e:c5:57:fe", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85cae254-0a", "ovs_interfaceid": "85cae254-0a31-46a2-8024-497b09a83744", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_vif [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85cae254-0a, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbd7045d-6da0-4fd6-bd1e-de9b2754e692) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:04 user nova-compute[74934]: INFO os_vif [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:57:fe,bridge_name='br-int',has_traffic_filtering=True,id=85cae254-0a31-46a2-8024-497b09a83744,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85cae254-0a')
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:afb1091b-c1f9-4e22-ae7f-026ef0d3602f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xrdUbKzD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:15:04 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[3a96b03d-9b61-40c4-b713-cd837d728da5]: Unexpected error while running command.
Nov 19 15:15:04 user nova-compute[74934]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 19 15:15:04 user nova-compute[74934]: Exit code: 21
Nov 19 15:15:04 user nova-compute[74934]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 19 15:15:04 user nova-compute[74934]: Stderr: '' {{(pid=86319) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 19 15:15:04 user nova-compute[74934]: Traceback (most recent call last):
Nov 19 15:15:04 user nova-compute[74934]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 19 15:15:04 user nova-compute[74934]:     ret = func(*f_args, **f_kwargs)
Nov 19 15:15:04 user nova-compute[74934]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 19 15:15:04 user nova-compute[74934]:     return func(*args, **kwargs)
Nov 19 15:15:04 user nova-compute[74934]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 19 15:15:04 user nova-compute[74934]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 19 15:15:04 user nova-compute[74934]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 19 15:15:04 user nova-compute[74934]:     return putils.execute(on_execute=on_execute,
Nov 19 15:15:04 user nova-compute[74934]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 19 15:15:04 user nova-compute[74934]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 19 15:15:04 user nova-compute[74934]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 19 15:15:04 user nova-compute[74934]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 19 15:15:04 user nova-compute[74934]: Exit code: 21
Nov 19 15:15:04 user nova-compute[74934]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 19 15:15:04 user nova-compute[74934]: Stderr: ''
Nov 19 15:15:04 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a96b03d-9b61-40c4-b713-cd837d728da5]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 19 15:15:04 user nova-compute[74934]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 19 15:15:04 user nova-compute[74934]: Exit code: 21
Nov 19 15:15:04 user nova-compute[74934]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 19 15:15:04 user nova-compute[74934]: Stderr: ''
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 19 15:15:04 user nova-compute[74934]: ERROR os_brick.initiator.connectors.iscsi 
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74934) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== disconnect_volume: return (29ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:15:04 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Deleting instance files /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510_del
Nov 19 15:15:04 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Deletion of /opt/stack/data/nova/instances/00dcefc8-8b25-4957-ad29-3ff5c6672510_del complete
Nov 19 15:15:04 user nova-compute[74934]: INFO nova.compute.manager [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 19 15:15:04 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:15:04 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:15:05 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:15:05 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Took 1.13 seconds to deallocate network for instance.
Nov 19 15:15:05 user nova-compute[74934]: WARNING nova.volume.cinder [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Attachment 68e325f6-40bd-4901-8dd9-f69ecdaf4465 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 68e325f6-40bd-4901-8dd9-f69ecdaf4465. (HTTP 404) (Request-ID: req-8da1cf9e-0fa0-4a48-8aa0-5b51d21ae93d)
Nov 19 15:15:05 user nova-compute[74934]: INFO nova.compute.manager [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Took 0.03 seconds to detach 1 volumes for instance.
Nov 19 15:15:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] Acquiring lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] No waiting events found dispatching network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:15:06 user nova-compute[74934]: WARNING nova.compute.manager [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received unexpected event network-vif-plugged-85cae254-0a31-46a2-8024-497b09a83744 for instance with vm_state deleted and task_state None.
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-aec9a01d-351e-4d09-bbec-fa1ba9184f9e req-5d259d33-608e-4e1a-9eac-2f678d7babab service nova] [instance: 00dcefc8-8b25-4957-ad29-3ff5c6672510] Received event network-vif-deleted-85cae254-0a31-46a2-8024-497b09a83744 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:15:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:06 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Deleted allocations for instance 00dcefc8-8b25-4957-ad29-3ff5c6672510
Nov 19 15:15:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-df123528-0e00-4599-b7e5-e6a33ed6a7b4 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "00dcefc8-8b25-4957-ad29-3ff5c6672510" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:15:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:15:10 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:15:10 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.14129638671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:15:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:11 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:15:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:15:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "0e58c917-6549-4b78-a435-a3f855508446" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:15:17 user nova-compute[74934]: INFO nova.compute.claims [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Claim successful on node user
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:15:17 user nova-compute[74934]: DEBUG nova.network.neutron [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:15:17 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:15:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG nova.policy [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ade11c889684ca9b402fa1066e4b629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441622bd90c1460fb78ac8ebdbead719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:15:18 user nova-compute[74934]: INFO nova.virt.block_device [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Booting with volume 533b04f4-6fe6-4052-a997-cecf3c3dad07 at /dev/vda
Nov 19 15:15:18 user nova-compute[74934]: DEBUG os_brick.utils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[de27feaf-1bd7-4bd8-bd87-03e7b811b831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[592bbed6-7915-4268-aedc-968b3594fc7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7107ef-333b-4a0f-84a0-7348fe03abd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567b760-1b93-4d2d-8b91-156d491690f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:15:18 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffaedaa-b9f2-40ee-8df1-d477a9770bc5]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG os_brick.utils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updating existing volume attachment record: f69cea73-598f-4bf3-858d-22b4b7190271 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Successfully created port: fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Successfully updated port: fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquired lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-changed-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.compute.manager [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Refreshing instance network info cache due to event network-changed-fa7b751f-294e-40dd-b5db-dee7a537c1fd. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] Acquiring lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updating instance_info_cache with network_info: [{"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Releasing lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Instance network_info: |[{"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] Acquired lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Refreshing network info cache for port fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updated VIF entry in instance network info cache for port fa7b751f-294e-40dd-b5db-dee7a537c1fd. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG nova.network.neutron [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updating instance_info_cache with network_info: [{"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:15:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-dadd7e8d-589f-4f97-93db-d47d6f92675c req-d009844f-e5d3-460e-80e9-d15c298b58d7 service nova] Releasing lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:15:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:15:23 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Creating image(s)
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Ensure instance console log exists: /opt/stack/data/nova/instances/0e58c917-6549-4b78-a435-a3f855508446/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Start _get_guest_xml network_info=[{"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'f69cea73-598f-4bf3-858d-22b4b7190271', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e58c917-6549-4b78-a435-a3f855508446', 'attached_at': '', 'detached_at': '', 'volume_id': '533b04f4-6fe6-4052-a997-cecf3c3dad07', 'serial': '533b04f4-6fe6-4052-a997-cecf3c3dad07'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:15:23 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:15:23 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:15:23 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:15:23 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:15:23 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f43d0-577d-49f4-816a-f14df4889085]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:15:23 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b085a00-24e9-4648-83a6-7e76e47e89cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07] added
Nov 19 15:15:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[914835f1-75c3-4af5-af89-fe5bcfc80384]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc707d3-8073-44ca-b7b9-5d3db4ce5d49]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWzVfhjD {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWzVfhjD" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad484a2-eae1-4caf-9d64-ac5ee42e816e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWzVfhjD'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac24e821-194f-4c41-b2cf-b5a95fc40900]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[daefe08a-a1e7-41f2-9391-ae000bf2313c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:15:23 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:15:23 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:15:23 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:15:23 user nova-compute[74934]: 
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c236b-cfef-49a2-9766-12e270fec9ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]
Nov 19 15:15:23 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.
Nov 19 15:15:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3b9381-3dbc-4297-bf51-df6d29c4bf34]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df586b2b-af49-4c19-a444-5622fff43046]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:15:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:15:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b750025f-fd59-48ad-9f45-c775e018dc94]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:15:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23931663630383737', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931663630383737', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-824717624',display_name='tempest-TestVolumeBootPattern-server-824717624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-824717624',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-7y9lbo7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:15:18Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=0e58c917-6549-4b78-a435-a3f855508446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.objects.instance [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e58c917-6549-4b78-a435-a3f855508446 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:15:24 user nova-compute[74934]:   <uuid>0e58c917-6549-4b78-a435-a3f855508446</uuid>
Nov 19 15:15:24 user nova-compute[74934]:   <name>instance-00000030</name>
Nov 19 15:15:24 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:15:24 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:15:24 user nova-compute[74934]:   <metadata>
Nov 19 15:15:24 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:15:24 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:15:24 user nova-compute[74934]:       <nova:name>tempest-TestVolumeBootPattern-server-824717624</nova:name>
Nov 19 15:15:24 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:15:23</nova:creationTime>
Nov 19 15:15:24 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:15:24 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:15:24 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:15:24 user nova-compute[74934]:       <nova:owner>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:user uuid="3ade11c889684ca9b402fa1066e4b629">tempest-TestVolumeBootPattern-686579107-project-member</nova:user>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:project uuid="441622bd90c1460fb78ac8ebdbead719">tempest-TestVolumeBootPattern-686579107</nova:project>
Nov 19 15:15:24 user nova-compute[74934]:       </nova:owner>
Nov 19 15:15:24 user nova-compute[74934]:       <nova:ports>
Nov 19 15:15:24 user nova-compute[74934]:         <nova:port uuid="fa7b751f-294e-40dd-b5db-dee7a537c1fd">
Nov 19 15:15:24 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 19 15:15:24 user nova-compute[74934]:         </nova:port>
Nov 19 15:15:24 user nova-compute[74934]:       </nova:ports>
Nov 19 15:15:24 user nova-compute[74934]:     </nova:instance>
Nov 19 15:15:24 user nova-compute[74934]:   </metadata>
Nov 19 15:15:24 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:15:24 user nova-compute[74934]:     <system>
Nov 19 15:15:24 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:15:24 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:15:24 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:15:24 user nova-compute[74934]:       <entry name="serial">0e58c917-6549-4b78-a435-a3f855508446</entry>
Nov 19 15:15:24 user nova-compute[74934]:       <entry name="uuid">0e58c917-6549-4b78-a435-a3f855508446</entry>
Nov 19 15:15:24 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:15:24 user nova-compute[74934]:     </system>
Nov 19 15:15:24 user nova-compute[74934]:   </sysinfo>
Nov 19 15:15:24 user nova-compute[74934]:   <os>
Nov 19 15:15:24 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:15:24 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:15:24 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:15:24 user nova-compute[74934]:   </os>
Nov 19 15:15:24 user nova-compute[74934]:   <features>
Nov 19 15:15:24 user nova-compute[74934]:     <acpi/>
Nov 19 15:15:24 user nova-compute[74934]:     <apic/>
Nov 19 15:15:24 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:15:24 user nova-compute[74934]:   </features>
Nov 19 15:15:24 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:15:24 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:15:24 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:15:24 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:15:24 user nova-compute[74934]:   </clock>
Nov 19 15:15:24 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:15:24 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:15:24 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:15:24 user nova-compute[74934]:   </cpu>
Nov 19 15:15:24 user nova-compute[74934]:   <devices>
Nov 19 15:15:24 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:15:24 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:15:24 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 15:15:24 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:15:24 user nova-compute[74934]:       <serial>533b04f4-6fe6-4052-a997-cecf3c3dad07</serial>
Nov 19 15:15:24 user nova-compute[74934]:     </disk>
Nov 19 15:15:24 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:15:24 user nova-compute[74934]:       <mac address="fa:16:3e:29:7c:a1"/>
Nov 19 15:15:24 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:15:24 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:15:24 user nova-compute[74934]:       <target dev="tapfa7b751f-29"/>
Nov 19 15:15:24 user nova-compute[74934]:     </interface>
Nov 19 15:15:24 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:15:24 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/0e58c917-6549-4b78-a435-a3f855508446/console.log" append="off"/>
Nov 19 15:15:24 user nova-compute[74934]:     </serial>
Nov 19 15:15:24 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:15:24 user nova-compute[74934]:     <video>
Nov 19 15:15:24 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:15:24 user nova-compute[74934]:     </video>
Nov 19 15:15:24 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:15:24 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:15:24 user nova-compute[74934]:     </rng>
Nov 19 15:15:24 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:15:24 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:15:24 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:15:24 user nova-compute[74934]:     </memballoon>
Nov 19 15:15:24 user nova-compute[74934]:   </devices>
Nov 19 15:15:24 user nova-compute[74934]: </domain>
Nov 19 15:15:24 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-824717624',display_name='tempest-TestVolumeBootPattern-server-824717624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-824717624',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-7y9lbo7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:15:18Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=0e58c917-6549-4b78-a435-a3f855508446,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG os_vif [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f247130f-b0b9-5d39-9d15-97ee570cb46f', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa7b751f-29, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa7b751f-29, col_values=(('qos', UUID('7d7e8460-a6a5-4bf0-90da-6818611ef3e5')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa7b751f-29, col_values=(('external_ids', {'iface-id': 'fa7b751f-294e-40dd-b5db-dee7a537c1fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:7c:a1', 'vm-uuid': '0e58c917-6549-4b78-a435-a3f855508446'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:24 user nova-compute[74934]: INFO os_vif [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29')
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:15:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No VIF found with MAC fa:16:3e:29:7c:a1, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-13480f62-fbb1-474f-9f71-65f53bbbfc69 req-de1c3a18-5c14-42cb-9662-15f1d56094ec service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13480f62-fbb1-474f-9f71-65f53bbbfc69 req-de1c3a18-5c14-42cb-9662-15f1d56094ec service nova] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13480f62-fbb1-474f-9f71-65f53bbbfc69 req-de1c3a18-5c14-42cb-9662-15f1d56094ec service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-13480f62-fbb1-474f-9f71-65f53bbbfc69 req-de1c3a18-5c14-42cb-9662-15f1d56094ec service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG nova.compute.manager [req-13480f62-fbb1-474f-9f71-65f53bbbfc69 req-de1c3a18-5c14-42cb-9662-15f1d56094ec service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] No waiting events found dispatching network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:15:26 user nova-compute[74934]: WARNING nova.compute.manager [req-13480f62-fbb1-474f-9f71-65f53bbbfc69 req-de1c3a18-5c14-42cb-9662-15f1d56094ec service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received unexpected event network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd for instance with vm_state building and task_state spawning.
Nov 19 15:15:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:15:28 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Instance spawned successfully.
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:28 user nova-compute[74934]: INFO nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-a68ddc8b-f9df-4e23-9bb2-511556d86d6d req-65f038fa-f99c-4401-aa5e-de9e0b9b5dd4 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a68ddc8b-f9df-4e23-9bb2-511556d86d6d req-65f038fa-f99c-4401-aa5e-de9e0b9b5dd4 service nova] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a68ddc8b-f9df-4e23-9bb2-511556d86d6d req-65f038fa-f99c-4401-aa5e-de9e0b9b5dd4 service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-a68ddc8b-f9df-4e23-9bb2-511556d86d6d req-65f038fa-f99c-4401-aa5e-de9e0b9b5dd4 service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-a68ddc8b-f9df-4e23-9bb2-511556d86d6d req-65f038fa-f99c-4401-aa5e-de9e0b9b5dd4 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] No waiting events found dispatching network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:15:28 user nova-compute[74934]: WARNING nova.compute.manager [req-a68ddc8b-f9df-4e23-9bb2-511556d86d6d req-65f038fa-f99c-4401-aa5e-de9e0b9b5dd4 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received unexpected event network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd for instance with vm_state building and task_state spawning.
Nov 19 15:15:28 user nova-compute[74934]: INFO nova.compute.manager [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Took 10.69 seconds to build instance.
Nov 19 15:15:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-12460ed4-5f1d-4747-b87b-baeaffbbe57d tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "0e58c917-6549-4b78-a435-a3f855508446" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.777s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:15:48 user nova-compute[74934]: INFO nova.compute.claims [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Claim successful on node user
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:15:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.policy [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af4ac7e0af2f4e8a9178d13c163127ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5267083f3a3a47e0879531209fbf41c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:15:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Creating image(s)
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "/opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "/opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "/opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.239s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk 1073741824" returned: 0 in 0.062s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Successfully created port: 03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Cannot resize image /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Ensure instance console log exists: /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Successfully updated port: 03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquired lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-changed-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Refreshing instance network info cache due to event network-changed-03ab088d-9480-4ddf-b2b8-5ba3b2939594. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] Acquiring lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updating instance_info_cache with network_info: [{"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Releasing lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Instance network_info: |[{"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] Acquired lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Refreshing network info cache for port 03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Start _get_guest_xml network_info=[{"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:15:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:15:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2106681210',display_name='tempest-VolumesSnapshotTestJSON-instance-2106681210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2106681210',id=49,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2Gup8wsdaadQ3GYyDMt56XAeWMoaCH2ZQ0Q1jeSLw93h8k4cf3n61E8vbZuDISoJD2cNgUfCfYwVZ+CNJNSETWL+cCmGagu2NV/1c79Y9gg3P5EJN4/t9QjjlvumOUEQ==',key_name='tempest-keypair-22070016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5267083f3a3a47e0879531209fbf41c4',ramdisk_id='',reservation_id='r-i8i8qwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1690859431',owner_user_name='tempest-VolumesSnapshotTestJSON-1690859431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af4ac7e0af2f4e8a9178d13c163127ce',uuid=609d9c83-c76a-4349-94b9-fd5271bbaf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converting VIF {"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'pci_devices' on Instance uuid 609d9c83-c76a-4349-94b9-fd5271bbaf9f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:15:50 user nova-compute[74934]:   <uuid>609d9c83-c76a-4349-94b9-fd5271bbaf9f</uuid>
Nov 19 15:15:50 user nova-compute[74934]:   <name>instance-00000031</name>
Nov 19 15:15:50 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:15:50 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:15:50 user nova-compute[74934]:   <metadata>
Nov 19 15:15:50 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:15:50 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:15:50 user nova-compute[74934]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2106681210</nova:name>
Nov 19 15:15:50 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:15:50</nova:creationTime>
Nov 19 15:15:50 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:15:50 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:15:50 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:15:50 user nova-compute[74934]:       <nova:owner>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:user uuid="af4ac7e0af2f4e8a9178d13c163127ce">tempest-VolumesSnapshotTestJSON-1690859431-project-member</nova:user>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:project uuid="5267083f3a3a47e0879531209fbf41c4">tempest-VolumesSnapshotTestJSON-1690859431</nova:project>
Nov 19 15:15:50 user nova-compute[74934]:       </nova:owner>
Nov 19 15:15:50 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:15:50 user nova-compute[74934]:       <nova:ports>
Nov 19 15:15:50 user nova-compute[74934]:         <nova:port uuid="03ab088d-9480-4ddf-b2b8-5ba3b2939594">
Nov 19 15:15:50 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 15:15:50 user nova-compute[74934]:         </nova:port>
Nov 19 15:15:50 user nova-compute[74934]:       </nova:ports>
Nov 19 15:15:50 user nova-compute[74934]:     </nova:instance>
Nov 19 15:15:50 user nova-compute[74934]:   </metadata>
Nov 19 15:15:50 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:15:50 user nova-compute[74934]:     <system>
Nov 19 15:15:50 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:15:50 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:15:50 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:15:50 user nova-compute[74934]:       <entry name="serial">609d9c83-c76a-4349-94b9-fd5271bbaf9f</entry>
Nov 19 15:15:50 user nova-compute[74934]:       <entry name="uuid">609d9c83-c76a-4349-94b9-fd5271bbaf9f</entry>
Nov 19 15:15:50 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:15:50 user nova-compute[74934]:     </system>
Nov 19 15:15:50 user nova-compute[74934]:   </sysinfo>
Nov 19 15:15:50 user nova-compute[74934]:   <os>
Nov 19 15:15:50 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:15:50 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:15:50 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:15:50 user nova-compute[74934]:   </os>
Nov 19 15:15:50 user nova-compute[74934]:   <features>
Nov 19 15:15:50 user nova-compute[74934]:     <acpi/>
Nov 19 15:15:50 user nova-compute[74934]:     <apic/>
Nov 19 15:15:50 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:15:50 user nova-compute[74934]:   </features>
Nov 19 15:15:50 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:15:50 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:15:50 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:15:50 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:15:50 user nova-compute[74934]:   </clock>
Nov 19 15:15:50 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:15:50 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:15:50 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:15:50 user nova-compute[74934]:   </cpu>
Nov 19 15:15:50 user nova-compute[74934]:   <devices>
Nov 19 15:15:50 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:15:50 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:15:50 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk"/>
Nov 19 15:15:50 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:15:50 user nova-compute[74934]:     </disk>
Nov 19 15:15:50 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:15:50 user nova-compute[74934]:       <mac address="fa:16:3e:bc:de:9a"/>
Nov 19 15:15:50 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:15:50 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:15:50 user nova-compute[74934]:       <target dev="tap03ab088d-94"/>
Nov 19 15:15:50 user nova-compute[74934]:     </interface>
Nov 19 15:15:50 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:15:50 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/console.log" append="off"/>
Nov 19 15:15:50 user nova-compute[74934]:     </serial>
Nov 19 15:15:50 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:15:50 user nova-compute[74934]:     <video>
Nov 19 15:15:50 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:15:50 user nova-compute[74934]:     </video>
Nov 19 15:15:50 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:15:50 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:15:50 user nova-compute[74934]:     </rng>
Nov 19 15:15:50 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:15:50 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:15:50 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:15:50 user nova-compute[74934]:     </memballoon>
Nov 19 15:15:50 user nova-compute[74934]:   </devices>
Nov 19 15:15:50 user nova-compute[74934]: </domain>
Nov 19 15:15:50 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2106681210',display_name='tempest-VolumesSnapshotTestJSON-instance-2106681210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2106681210',id=49,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2Gup8wsdaadQ3GYyDMt56XAeWMoaCH2ZQ0Q1jeSLw93h8k4cf3n61E8vbZuDISoJD2cNgUfCfYwVZ+CNJNSETWL+cCmGagu2NV/1c79Y9gg3P5EJN4/t9QjjlvumOUEQ==',key_name='tempest-keypair-22070016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5267083f3a3a47e0879531209fbf41c4',ramdisk_id='',reservation_id='r-i8i8qwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1690859431',owner_user_name='tempest-VolumesSnapshotTestJSON-1690859431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af4ac7e0af2f4e8a9178d13c163127ce',uuid=609d9c83-c76a-4349-94b9-fd5271bbaf9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converting VIF {"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG os_vif [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dde6680f-a161-5875-bfff-a86a00eea5dc', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03ab088d-94, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03ab088d-94, col_values=(('qos', UUID('aeae06be-4167-4302-af3c-1a4150d786ec')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03ab088d-94, col_values=(('external_ids', {'iface-id': '03ab088d-9480-4ddf-b2b8-5ba3b2939594', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:de:9a', 'vm-uuid': '609d9c83-c76a-4349-94b9-fd5271bbaf9f'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:50 user nova-compute[74934]: INFO os_vif [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94')
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No VIF found with MAC fa:16:3e:bc:de:9a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updated VIF entry in instance network info cache for port 03ab088d-9480-4ddf-b2b8-5ba3b2939594. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updating instance_info_cache with network_info: [{"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:15:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1118c87e-5a4c-42d5-bdf6-8a4678408b41 req-be0873b6-cf9f-4cf0-8f82-8a194c86e45c service nova] Releasing lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:15:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-b1529083-fdc5-49fe-980a-00fb3eaca6ff req-298124f3-b9ab-430d-9ccc-3117225d992f service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b1529083-fdc5-49fe-980a-00fb3eaca6ff req-298124f3-b9ab-430d-9ccc-3117225d992f service nova] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b1529083-fdc5-49fe-980a-00fb3eaca6ff req-298124f3-b9ab-430d-9ccc-3117225d992f service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b1529083-fdc5-49fe-980a-00fb3eaca6ff req-298124f3-b9ab-430d-9ccc-3117225d992f service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-b1529083-fdc5-49fe-980a-00fb3eaca6ff req-298124f3-b9ab-430d-9ccc-3117225d992f service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] No waiting events found dispatching network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:15:52 user nova-compute[74934]: WARNING nova.compute.manager [req-b1529083-fdc5-49fe-980a-00fb3eaca6ff req-298124f3-b9ab-430d-9ccc-3117225d992f service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received unexpected event network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 for instance with vm_state building and task_state spawning.
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:15:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Instance spawned successfully.
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:15:54 user nova-compute[74934]: INFO nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-3c4f0b1c-4a6b-4898-8ece-00ae246ad608 req-a782c529-d79b-40d0-97b2-320f834aa88f service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3c4f0b1c-4a6b-4898-8ece-00ae246ad608 req-a782c529-d79b-40d0-97b2-320f834aa88f service nova] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3c4f0b1c-4a6b-4898-8ece-00ae246ad608 req-a782c529-d79b-40d0-97b2-320f834aa88f service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3c4f0b1c-4a6b-4898-8ece-00ae246ad608 req-a782c529-d79b-40d0-97b2-320f834aa88f service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-3c4f0b1c-4a6b-4898-8ece-00ae246ad608 req-a782c529-d79b-40d0-97b2-320f834aa88f service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] No waiting events found dispatching network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:15:54 user nova-compute[74934]: WARNING nova.compute.manager [req-3c4f0b1c-4a6b-4898-8ece-00ae246ad608 req-a782c529-d79b-40d0-97b2-320f834aa88f service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received unexpected event network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 for instance with vm_state building and task_state spawning.
Nov 19 15:15:54 user nova-compute[74934]: INFO nova.compute.manager [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Took 6.03 seconds to build instance.
Nov 19 15:15:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ecc653c0-4992-454d-9a54-1de59260b3e9 tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.127s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:15:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:15:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:03 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:16:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:11 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:16:11 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.103763580322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 0e58c917-6549-4b78-a435-a3f855508446 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:16:11 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:16:12 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 0e58c917-6549-4b78-a435-a3f855508446 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:16:13 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updating instance_info_cache with network_info: [{"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:16:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:16:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:16:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:16:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:16:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:16:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:16:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:16:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:16:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:16:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:16:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:16:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:16:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:16:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:17:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:17:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:17:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:17:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-changed-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG nova.compute.manager [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Refreshing instance network info cache due to event network-changed-fa7b751f-294e-40dd-b5db-dee7a537c1fd. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] Acquiring lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] Acquired lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG nova.network.neutron [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Refreshing network info cache for port fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "0e58c917-6549-4b78-a435-a3f855508446" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:09 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:09 user nova-compute[74934]: INFO nova.compute.manager [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Terminating instance
Nov 19 15:17:09 user nova-compute[74934]: DEBUG nova.compute.manager [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updated VIF entry in instance network info cache for port fa7b751f-294e-40dd-b5db-dee7a537c1fd. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.network.neutron [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updating instance_info_cache with network_info: [{"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-434d7e0c-9d8d-497b-aff8-a1fad6e8dce4 req-2b6fd28b-f005-415e-9a64-66c298e6f3ac service nova] Releasing lock "refresh_cache-0e58c917-6549-4b78-a435-a3f855508446" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-311f5d69-c15b-4f8e-84ef-584af61f5fe7 req-bf8047f9-c6aa-4928-b269-bbaa4ff9c24b service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-vif-unplugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-311f5d69-c15b-4f8e-84ef-584af61f5fe7 req-bf8047f9-c6aa-4928-b269-bbaa4ff9c24b service nova] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-311f5d69-c15b-4f8e-84ef-584af61f5fe7 req-bf8047f9-c6aa-4928-b269-bbaa4ff9c24b service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-311f5d69-c15b-4f8e-84ef-584af61f5fe7 req-bf8047f9-c6aa-4928-b269-bbaa4ff9c24b service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-311f5d69-c15b-4f8e-84ef-584af61f5fe7 req-bf8047f9-c6aa-4928-b269-bbaa4ff9c24b service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] No waiting events found dispatching network-vif-unplugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-311f5d69-c15b-4f8e-84ef-584af61f5fe7 req-bf8047f9-c6aa-4928-b269-bbaa4ff9c24b service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-vif-unplugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Instance destroyed successfully.
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.objects.instance [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'resources' on Instance uuid 0e58c917-6549-4b78-a435-a3f855508446 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-824717624',display_name='tempest-TestVolumeBootPattern-server-824717624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-824717624',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-7y9lbo7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:15:28Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=0e58c917-6549-4b78-a435-a3f855508446,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "address": "fa:16:3e:29:7c:a1", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7b751f-29", "ovs_interfaceid": "fa7b751f-294e-40dd-b5db-dee7a537c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_vif [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa7b751f-29, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d7e8460-a6a5-4bf0-90da-6818611ef3e5) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:10 user nova-compute[74934]: INFO os_vif [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:7c:a1,bridge_name='br-int',has_traffic_filtering=True,id=fa7b751f-294e-40dd-b5db-dee7a537c1fd,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7b751f-29')
Nov 19 15:17:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:17:10 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5036eb5-4c72-47b4-89c6-b594a4c1d9b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:17:10 user nova-compute[74934]: No targets found.
Nov 19 15:17:10 user nova-compute[74934]: iSNS:
Nov 19 15:17:10 user nova-compute[74934]: No targets found.
Nov 19 15:17:10 user nova-compute[74934]: STATIC:
Nov 19 15:17:10 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07
Nov 19 15:17:10 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:17:10 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:17:10 user nova-compute[74934]: FIRMWARE:
Nov 19 15:17:10 user nova-compute[74934]: No targets found.
Nov 19 15:17:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:17:10 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:17:10 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc82ed6-4cd3-4201-8dac-c9590b4c1173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae78980-ec46-4f12-abd1-b34c54253c93]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:17:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:17:10 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e8d29900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff0f33-364e-4d98-be0a-0560e2554716]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:10 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fa5ec9-a3f3-4b23-ad9b-a4488664991d]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca5369b-aa32-4796-9298-8b6fd01fd76b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3b9c2c-62a6-4808-8ed5-c076541da690]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f6295-0f38-4d1d-b52e-8293d5c8f500]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e625ecb-1f8a-4a73-9925-a1296a71014a]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]
Nov 19 15:17:11 user nova-compute[74934]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.
Nov 19 15:17:11 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0435104-d4e7-4736-aa68-3892e0500c40]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== disconnect_volume: return (302ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:17:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Deleting instance files /opt/stack/data/nova/instances/0e58c917-6549-4b78-a435-a3f855508446_del
Nov 19 15:17:11 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Deletion of /opt/stack/data/nova/instances/0e58c917-6549-4b78-a435-a3f855508446_del complete
Nov 19 15:17:11 user nova-compute[74934]: INFO nova.compute.manager [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0e58c917-6549-4b78-a435-a3f855508446] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:11 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:17:11 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Took 0.66 seconds to deallocate network for instance.
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] Acquiring lock "0e58c917-6549-4b78-a435-a3f855508446-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] Lock "0e58c917-6549-4b78-a435-a3f855508446-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] No waiting events found dispatching network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:17:12 user nova-compute[74934]: WARNING nova.compute.manager [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received unexpected event network-vif-plugged-fa7b751f-294e-40dd-b5db-dee7a537c1fd for instance with vm_state active and task_state deleting.
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-c1765d3d-a6cf-4670-96b7-0a15c57f14f4 req-fe3ed9e9-5bd1-4be3-9a4d-6e3c245d6b36 service nova] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Received event network-vif-deleted-fa7b751f-294e-40dd-b5db-dee7a537c1fd {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:17:12 user nova-compute[74934]: INFO nova.compute.manager [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: 0e58c917-6549-4b78-a435-a3f855508446] Took 0.79 seconds to detach 1 volumes for instance.
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updating instance_info_cache with network_info: [{"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:12 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Deleted allocations for instance 0e58c917-6549-4b78-a435-a3f855508446
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:12 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-975aeb70-6955-457f-9c3a-b13cc495888a tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "0e58c917-6549-4b78-a435-a3f855508446" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:17:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:17:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.101207733154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:17:13 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:17:14 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:17:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:17:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-changed-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Refreshing instance network info cache due to event network-changed-03ab088d-9480-4ddf-b2b8-5ba3b2939594. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] Acquiring lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] Acquired lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.network.neutron [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Refreshing network info cache for port 03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'flavor' on Instance uuid 609d9c83-c76a-4349-94b9-fd5271bbaf9f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:17:39 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Ignoring supplied device name: /dev/vdb
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:39 user nova-compute[74934]: INFO nova.compute.manager [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Attaching volume 809c4336-c0a9-4c16-8fd8-a5e08ca885b8 to /dev/vdb
Nov 19 15:17:39 user nova-compute[74934]: DEBUG os_brick.utils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[60837e88-d35e-4409-bd5f-7a52dc0c1dfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a2bcf-13ef-4f7e-8fcb-6626977a25a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.network.neutron [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updated VIF entry in instance network info cache for port 03ab088d-9480-4ddf-b2b8-5ba3b2939594. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.network.neutron [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updating instance_info_cache with network_info: [{"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f127486-71a9-41d7-852e-ce498004d31b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a55a601-7784-4932-93ec-333200f9b6ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-51c29351-0dd3-4301-9e25-96f27c8842f2 req-6b726078-eead-44aa-882d-5f157e03a2b7 service nova] Releasing lock "refresh_cache-609d9c83-c76a-4349-94b9-fd5271bbaf9f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:17:39 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:17:39 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b75d6ef-8834-4b98-92d0-b18362870d68]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG os_brick.utils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:17:39 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updating existing volume attachment record: 6561bdf8-2cdb-45e3-b80e-de77f07abb59 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:17:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:17:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSuIWBRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:17:45 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:17:45 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:17:45 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e509e2-4a6d-435a-b883-1b7b33d37272]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:17:45 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d74e5a-746a-46f8-ad92-145c2a8092dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8] added
Nov 19 15:17:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd2d27-e505-4840-814c-bf3ae9a6bd3f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f945cbce-a35d-46a8-a604-9564b3f82f6a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MSuIWBRT {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MSuIWBRT" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba0b32d-ccad-4e33-9af1-3469e38976db]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MSuIWBRT'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[676985ff-3e18-410b-9f8c-bc74ff602f7f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1311804-e32f-4e73-b3f9-3a2506df1e87]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:17:45 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:17:45 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:17:45 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:17:45 user nova-compute[74934]: 
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d0d727-29ad-4c86-8c2e-b79edc235a86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260]
Nov 19 15:17:45 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260] successful.
Nov 19 15:17:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2604120-1713-4687-8245-0e79c1226866]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70094b1c-1f18-4d4f-abac-52287747d686]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:17:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:17:45 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7baa3f-e2ce-4d4f-8d47-7c1be4c96d77]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:17:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSuIWBRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '23635346563313165', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635346563313165', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'flavor' on Instance uuid 609d9c83-c76a-4349-94b9-fd5271bbaf9f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:17:46 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:17:46 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:17:46 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:17:46 user nova-compute[74934]:   <serial>809c4336-c0a9-4c16-8fd8-a5e08ca885b8</serial>
Nov 19 15:17:46 user nova-compute[74934]: </disk>
Nov 19 15:17:46 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] No VIF found with MAC fa:16:3e:bc:de:9a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:17:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6c649960-faa9-4f8d-ba49-6ff94c35005f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.118s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:17:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:17:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:17:58 user nova-compute[74934]: INFO nova.compute.manager [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Detaching volume 809c4336-c0a9-4c16-8fd8-a5e08ca885b8
Nov 19 15:17:58 user nova-compute[74934]: INFO nova.virt.block_device [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Attempting to driver detach volume 809c4336-c0a9-4c16-8fd8-a5e08ca885b8 from mountpoint /dev/vdb
Nov 19 15:17:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Attempting to detach device vdb from instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:17:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:17:58 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:17:58 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:17:58 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:17:58 user nova-compute[74934]:   <serial>809c4336-c0a9-4c16-8fd8-a5e08ca885b8</serial>
Nov 19 15:17:58 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:17:58 user nova-compute[74934]: </disk>
Nov 19 15:17:58 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:17:58 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully detached device vdb from instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f from the persistent domain config.
Nov 19 15:17:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:17:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:17:58 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:17:58 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:17:58 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:17:58 user nova-compute[74934]:   <serial>809c4336-c0a9-4c16-8fd8-a5e08ca885b8</serial>
Nov 19 15:17:58 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:17:58 user nova-compute[74934]: </disk>
Nov 19 15:17:58 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:17:58 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:17:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:18:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "bbf746eb-6733-46ff-982a-c281906f5622" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:18:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:01 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:18:01 user nova-compute[74934]: INFO nova.compute.claims [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Claim successful on node user
Nov 19 15:18:01 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:18:02 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.policy [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ade11c889684ca9b402fa1066e4b629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441622bd90c1460fb78ac8ebdbead719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:18:02 user nova-compute[74934]: INFO nova.virt.block_device [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Booting with volume 533b04f4-6fe6-4052-a997-cecf3c3dad07 at /dev/vda
Nov 19 15:18:02 user nova-compute[74934]: DEBUG os_brick.utils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[347afc78-a6f4-405b-be6d-86ff091cd030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e4eb1a-882d-421d-9480-2d0609595197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca0124-7503-4ea7-aea9-b843bdc09103]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31fb943-4059-461f-9a9d-428abbf1a716]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:18:02 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:18:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[147da546-df2d-4de9-a323-2908b9c042fa]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG os_brick.utils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating existing volume attachment record: e605cbb5-5ef1-43dd-b8bd-b0c52b53dc88 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:18:02 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Successfully created port: ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Successfully updated port: ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-changed-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.compute.manager [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Refreshing instance network info cache due to event network-changed-ee09c339-6a43-4b59-b4c9-6f9536720959. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Refreshing network info cache for port ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-e9b8c8af-744a-4873-b8dd-8e43d01ed4f9 req-082fe602-3632-4efc-9830-bc213a9cfd79 service nova] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:18:03 user nova-compute[74934]: DEBUG nova.network.neutron [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:18:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:18:04 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Instance network_info: |[{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:18:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:18:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Creating image(s)
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Ensure instance console log exists: /opt/stack/data/nova/instances/bbf746eb-6733-46ff-982a-c281906f5622/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Start _get_guest_xml network_info=[{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': 'e605cbb5-5ef1-43dd-b8bd-b0c52b53dc88', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbf746eb-6733-46ff-982a-c281906f5622', 'attached_at': '', 'detached_at': '', 'volume_id': '533b04f4-6fe6-4052-a997-cecf3c3dad07', 'serial': '533b04f4-6fe6-4052-a997-cecf3c3dad07'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:18:07 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:18:07 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:18:07 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:18:07 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:18:07 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf5c495-fc1b-48f7-b898-af88e9345dfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:18:07 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f472bbd5-36ac-4c53-8646-b9c010db35d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07] added
Nov 19 15:18:07 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c6271b-0446-4819-b1ad-473a14dabe98]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db1294-f14a-40f5-b5e4-1393b1e8827c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWzVfhjD {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWzVfhjD" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bbac91-489e-403e-b026-55566ce746b4]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWzVfhjD'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:07 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf1a8ae-451a-4e8e-ae16-f568a4f4a6e2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e614c4ce-7ac7-4ec4-b895-effdfaa51979]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:18:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:18:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ccff52-c8c2-4d5d-b606-6fde81073189]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]
Nov 19 15:18:08 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.
Nov 19 15:18:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb0012e-4fd7-442d-9ca4-9609a8708f70]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[15851228-d127-4524-867c-dbec83edbe73]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:18:08 user nova-compute[74934]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:18:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:18:08 user nova-compute[74934]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:18:08 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec5339c-eb3f-444b-8c4b-e526aab3d636]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:08 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23931663630383737', 'path': '/dev/sdc'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931663630383737', 'path': '/dev/sdc'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-898720729',display_name='tempest-TestVolumeBootPattern-server-898720729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-898720729',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-h64ojljf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:18:02Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=bbf746eb-6733-46ff-982a-c281906f5622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'pci_devices' on Instance uuid bbf746eb-6733-46ff-982a-c281906f5622 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:18:09 user nova-compute[74934]:   <uuid>bbf746eb-6733-46ff-982a-c281906f5622</uuid>
Nov 19 15:18:09 user nova-compute[74934]:   <name>instance-00000032</name>
Nov 19 15:18:09 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:18:09 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:18:09 user nova-compute[74934]:   <metadata>
Nov 19 15:18:09 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:18:09 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:18:09 user nova-compute[74934]:       <nova:name>tempest-TestVolumeBootPattern-server-898720729</nova:name>
Nov 19 15:18:09 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:18:07</nova:creationTime>
Nov 19 15:18:09 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:18:09 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:18:09 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:18:09 user nova-compute[74934]:       <nova:owner>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:user uuid="3ade11c889684ca9b402fa1066e4b629">tempest-TestVolumeBootPattern-686579107-project-member</nova:user>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:project uuid="441622bd90c1460fb78ac8ebdbead719">tempest-TestVolumeBootPattern-686579107</nova:project>
Nov 19 15:18:09 user nova-compute[74934]:       </nova:owner>
Nov 19 15:18:09 user nova-compute[74934]:       <nova:ports>
Nov 19 15:18:09 user nova-compute[74934]:         <nova:port uuid="ee09c339-6a43-4b59-b4c9-6f9536720959">
Nov 19 15:18:09 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 19 15:18:09 user nova-compute[74934]:         </nova:port>
Nov 19 15:18:09 user nova-compute[74934]:       </nova:ports>
Nov 19 15:18:09 user nova-compute[74934]:     </nova:instance>
Nov 19 15:18:09 user nova-compute[74934]:   </metadata>
Nov 19 15:18:09 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:18:09 user nova-compute[74934]:     <system>
Nov 19 15:18:09 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:18:09 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:18:09 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:18:09 user nova-compute[74934]:       <entry name="serial">bbf746eb-6733-46ff-982a-c281906f5622</entry>
Nov 19 15:18:09 user nova-compute[74934]:       <entry name="uuid">bbf746eb-6733-46ff-982a-c281906f5622</entry>
Nov 19 15:18:09 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:18:09 user nova-compute[74934]:     </system>
Nov 19 15:18:09 user nova-compute[74934]:   </sysinfo>
Nov 19 15:18:09 user nova-compute[74934]:   <os>
Nov 19 15:18:09 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:18:09 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:18:09 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:18:09 user nova-compute[74934]:   </os>
Nov 19 15:18:09 user nova-compute[74934]:   <features>
Nov 19 15:18:09 user nova-compute[74934]:     <acpi/>
Nov 19 15:18:09 user nova-compute[74934]:     <apic/>
Nov 19 15:18:09 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:18:09 user nova-compute[74934]:   </features>
Nov 19 15:18:09 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:18:09 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:18:09 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:18:09 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:18:09 user nova-compute[74934]:   </clock>
Nov 19 15:18:09 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:18:09 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:18:09 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:18:09 user nova-compute[74934]:   </cpu>
Nov 19 15:18:09 user nova-compute[74934]:   <devices>
Nov 19 15:18:09 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:18:09 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:18:09 user nova-compute[74934]:       <source dev="/dev/sdc"/>
Nov 19 15:18:09 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:18:09 user nova-compute[74934]:       <serial>533b04f4-6fe6-4052-a997-cecf3c3dad07</serial>
Nov 19 15:18:09 user nova-compute[74934]:     </disk>
Nov 19 15:18:09 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:18:09 user nova-compute[74934]:       <mac address="fa:16:3e:32:ad:ac"/>
Nov 19 15:18:09 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:18:09 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:18:09 user nova-compute[74934]:       <target dev="tapee09c339-6a"/>
Nov 19 15:18:09 user nova-compute[74934]:     </interface>
Nov 19 15:18:09 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:18:09 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/bbf746eb-6733-46ff-982a-c281906f5622/console.log" append="off"/>
Nov 19 15:18:09 user nova-compute[74934]:     </serial>
Nov 19 15:18:09 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:18:09 user nova-compute[74934]:     <video>
Nov 19 15:18:09 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:18:09 user nova-compute[74934]:     </video>
Nov 19 15:18:09 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:18:09 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:18:09 user nova-compute[74934]:     </rng>
Nov 19 15:18:09 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:18:09 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:18:09 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:18:09 user nova-compute[74934]:     </memballoon>
Nov 19 15:18:09 user nova-compute[74934]:   </devices>
Nov 19 15:18:09 user nova-compute[74934]: </domain>
Nov 19 15:18:09 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-898720729',display_name='tempest-TestVolumeBootPattern-server-898720729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-898720729',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-h64ojljf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:18:02Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=bbf746eb-6733-46ff-982a-c281906f5622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG os_vif [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7665114-4f56-52aa-9ce4-e600dfd78e94', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee09c339-6a, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee09c339-6a, col_values=(('qos', UUID('8bcde45b-d22e-40e6-bb16-48b0d2645346')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee09c339-6a, col_values=(('external_ids', {'iface-id': 'ee09c339-6a43-4b59-b4c9-6f9536720959', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:ad:ac', 'vm-uuid': 'bbf746eb-6733-46ff-982a-c281906f5622'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:09 user nova-compute[74934]: INFO os_vif [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a')
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:18:09 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No VIF found with MAC fa:16:3e:32:ad:ac, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-bee0c50f-76a2-471c-a19c-ba4edb20c778 req-32a10028-8ca1-4fcf-8feb-c29c266e0d9c service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bee0c50f-76a2-471c-a19c-ba4edb20c778 req-32a10028-8ca1-4fcf-8feb-c29c266e0d9c service nova] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bee0c50f-76a2-471c-a19c-ba4edb20c778 req-32a10028-8ca1-4fcf-8feb-c29c266e0d9c service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bee0c50f-76a2-471c-a19c-ba4edb20c778 req-32a10028-8ca1-4fcf-8feb-c29c266e0d9c service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-bee0c50f-76a2-471c-a19c-ba4edb20c778 req-32a10028-8ca1-4fcf-8feb-c29c266e0d9c service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] No waiting events found dispatching network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:18:10 user nova-compute[74934]: WARNING nova.compute.manager [req-bee0c50f-76a2-471c-a19c-ba4edb20c778 req-32a10028-8ca1-4fcf-8feb-c29c266e0d9c service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received unexpected event network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 for instance with vm_state building and task_state spawning.
Nov 19 15:18:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:18:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Instance spawned successfully.
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:12 user nova-compute[74934]: INFO nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Took 4.85 seconds to spawn the instance on the hypervisor.
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f35156c-25d9-4669-bcbc-e5e26f97d978 req-d137c54e-6de5-472f-b896-fd126fa84629 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f35156c-25d9-4669-bcbc-e5e26f97d978 req-d137c54e-6de5-472f-b896-fd126fa84629 service nova] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f35156c-25d9-4669-bcbc-e5e26f97d978 req-d137c54e-6de5-472f-b896-fd126fa84629 service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f35156c-25d9-4669-bcbc-e5e26f97d978 req-d137c54e-6de5-472f-b896-fd126fa84629 service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f35156c-25d9-4669-bcbc-e5e26f97d978 req-d137c54e-6de5-472f-b896-fd126fa84629 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] No waiting events found dispatching network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:18:12 user nova-compute[74934]: WARNING nova.compute.manager [req-1f35156c-25d9-4669-bcbc-e5e26f97d978 req-d137c54e-6de5-472f-b896-fd126fa84629 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received unexpected event network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 for instance with vm_state building and task_state spawning.
Nov 19 15:18:12 user nova-compute[74934]: INFO nova.compute.manager [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Took 10.95 seconds to build instance.
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a46bc412-5cfe-47bc-882b-769ca44eebea tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "bbf746eb-6733-46ff-982a-c281906f5622" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.048s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:18:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=25.099056243896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bbf746eb-6733-46ff-982a-c281906f5622 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:18:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Skipping network cache update for instance because it is being deleted. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:18:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid bbf746eb-6733-46ff-982a-c281906f5622 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:18:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:18:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:18:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:18:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f is timed out.
Nov 19 15:18:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully detached device vdb from instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f from the live domain config.
Nov 19 15:18:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSuIWBRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:18:18 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40c8c7a-360f-4c58-a10d-302f7509ea58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:18:18 user nova-compute[74934]: No targets found.
Nov 19 15:18:18 user nova-compute[74934]: iSNS:
Nov 19 15:18:18 user nova-compute[74934]: No targets found.
Nov 19 15:18:18 user nova-compute[74934]: STATIC:
Nov 19 15:18:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07
Nov 19 15:18:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:18:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:18:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8
Nov 19 15:18:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:18:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:18:18 user nova-compute[74934]: FIRMWARE:
Nov 19 15:18:18 user nova-compute[74934]: No targets found.
Nov 19 15:18:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:18:18 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:18:18 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d227b365-aa33-430c-b3b0-78f616fa5db2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbde7a7e-7c4b-45f8-ab6e-5d2f28ab76d3]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:18:18 user nova-compute[74934]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:18:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 (non-flash)
Nov 19 15:18:18 user nova-compute[74934]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:18:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c43fdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa1fb1-6e57-4a8f-883d-467333cf92a8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8acf46-a1ea-4d59-8bc1-ccad0f11f3f2]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b57dd-7844-4787-9d39-02f657b9f77b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee582f0-1042-4dde-b57f-3974d6343369]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7b485-9167-4d34-99b5-17e99ba2923a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ca257-6284-4e46-a79b-9c78446a040c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260]
Nov 19 15:18:19 user nova-compute[74934]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8, portal: 172.16.0.220,3260] successful.
Nov 19 15:18:19 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5279bb-33e7-42c9-88ae-720614f54fa8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== disconnect_volume: return (300ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:18:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG nova.objects.instance [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'flavor' on Instance uuid 609d9c83-c76a-4349-94b9-fd5271bbaf9f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-f120f9d7-c356-4f93-80a6-9b99d2150afd tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.950s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.838s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:20 user nova-compute[74934]: INFO nova.compute.manager [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Terminating instance
Nov 19 15:18:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-3723f71e-fbd6-46d3-8eb2-9d869f93d20a req-7a6d3c7e-ca12-4b98-8162-1bec51845148 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-vif-unplugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3723f71e-fbd6-46d3-8eb2-9d869f93d20a req-7a6d3c7e-ca12-4b98-8162-1bec51845148 service nova] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3723f71e-fbd6-46d3-8eb2-9d869f93d20a req-7a6d3c7e-ca12-4b98-8162-1bec51845148 service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3723f71e-fbd6-46d3-8eb2-9d869f93d20a req-7a6d3c7e-ca12-4b98-8162-1bec51845148 service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-3723f71e-fbd6-46d3-8eb2-9d869f93d20a req-7a6d3c7e-ca12-4b98-8162-1bec51845148 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] No waiting events found dispatching network-vif-unplugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:18:20 user nova-compute[74934]: DEBUG nova.compute.manager [req-3723f71e-fbd6-46d3-8eb2-9d869f93d20a req-7a6d3c7e-ca12-4b98-8162-1bec51845148 service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-vif-unplugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:18:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Instance destroyed successfully.
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.objects.instance [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lazy-loading 'resources' on Instance uuid 609d9c83-c76a-4349-94b9-fd5271bbaf9f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2106681210',display_name='tempest-VolumesSnapshotTestJSON-instance-2106681210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2106681210',id=49,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2Gup8wsdaadQ3GYyDMt56XAeWMoaCH2ZQ0Q1jeSLw93h8k4cf3n61E8vbZuDISoJD2cNgUfCfYwVZ+CNJNSETWL+cCmGagu2NV/1c79Y9gg3P5EJN4/t9QjjlvumOUEQ==',key_name='tempest-keypair-22070016',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:15:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5267083f3a3a47e0879531209fbf41c4',ramdisk_id='',reservation_id='r-i8i8qwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1690859431',owner_user_name='tempest-VolumesSnapshotTestJSON-1690859431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='af4ac7e0af2f4e8a9178d13c163127ce',uuid=609d9c83-c76a-4349-94b9-fd5271bbaf9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converting VIF {"id": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "address": "fa:16:3e:bc:de:9a", "network": {"id": "7f57a3e5-2526-40c1-9554-4b878afe72cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-37628589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5267083f3a3a47e0879531209fbf41c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ab088d-94", "ovs_interfaceid": "03ab088d-9480-4ddf-b2b8-5ba3b2939594", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_vif [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03ab088d-94, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeae06be-4167-4302-af3c-1a4150d786ec) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:21 user nova-compute[74934]: INFO os_vif [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:de:9a,bridge_name='br-int',has_traffic_filtering=True,id=03ab088d-9480-4ddf-b2b8-5ba3b2939594,network=Network(7f57a3e5-2526-40c1-9554-4b878afe72cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ab088d-94')
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MSuIWBRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:18:21 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a80e47-57fb-4cc3-81d5-e62cd0bd7de5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:18:21 user nova-compute[74934]: No targets found.
Nov 19 15:18:21 user nova-compute[74934]: iSNS:
Nov 19 15:18:21 user nova-compute[74934]: No targets found.
Nov 19 15:18:21 user nova-compute[74934]: STATIC:
Nov 19 15:18:21 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07
Nov 19 15:18:21 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:18:21 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:18:21 user nova-compute[74934]: FIRMWARE:
Nov 19 15:18:21 user nova-compute[74934]: No targets found.
Nov 19 15:18:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:18:21 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:18:21 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:809c4336-c0a9-4c16-8fd8-a5e08ca885b8', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f3743-ceca-464b-ae58-d1c826493d2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884bbf0-7940-4722-8a16-52e071d0120d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:18:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:18:21 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc2248b0>, {}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Disconnecting from: [] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] <== disconnect_volume: return (75ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:18:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Deleting instance files /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f_del
Nov 19 15:18:21 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Deletion of /opt/stack/data/nova/instances/609d9c83-c76a-4349-94b9-fd5271bbaf9f_del complete
Nov 19 15:18:21 user nova-compute[74934]: INFO nova.compute.manager [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 19 15:18:21 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:18:21 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:18:22 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Took 0.81 seconds to deallocate network for instance.
Nov 19 15:18:22 user nova-compute[74934]: WARNING nova.volume.cinder [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Attachment 6561bdf8-2cdb-45e3-b80e-de77f07abb59 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6561bdf8-2cdb-45e3-b80e-de77f07abb59. (HTTP 404) (Request-ID: req-1d0dd851-2b95-4d30-8381-b44d7bdd52f7)
Nov 19 15:18:22 user nova-compute[74934]: INFO nova.compute.manager [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Took 0.02 seconds to detach 1 volumes for instance.
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:22 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Deleted allocations for instance 609d9c83-c76a-4349-94b9-fd5271bbaf9f
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-983d4a9f-7f90-4b32-83c2-21fa887c768f tempest-VolumesSnapshotTestJSON-1690859431 tempest-VolumesSnapshotTestJSON-1690859431-project-member] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] Acquiring lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] Lock "609d9c83-c76a-4349-94b9-fd5271bbaf9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:18:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] No waiting events found dispatching network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:18:22 user nova-compute[74934]: WARNING nova.compute.manager [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received unexpected event network-vif-plugged-03ab088d-9480-4ddf-b2b8-5ba3b2939594 for instance with vm_state deleted and task_state None.
Nov 19 15:18:22 user nova-compute[74934]: DEBUG nova.compute.manager [req-9e2df44c-25b2-4355-ae3f-17726aa516a8 req-6c7700e3-49c1-4e7c-a3e4-7cb3e745af7d service nova] [instance: 609d9c83-c76a-4349-94b9-fd5271bbaf9f] Received event network-vif-deleted-03ab088d-9480-4ddf-b2b8-5ba3b2939594 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:18:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:18:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:18:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:19:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:08 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:19:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:13 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:19:14 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid bbf746eb-6733-46ff-982a-c281906f5622 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:19:15 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:19:15 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.117473602294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bbf746eb-6733-46ff-982a-c281906f5622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:19:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:19:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:35 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:19:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:19:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:19:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-changed-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Refreshing instance network info cache due to event network-changed-ee09c339-6a43-4b59-b4c9-6f9536720959. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Refreshing network info cache for port ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updated VIF entry in instance network info cache for port ee09c339-6a43-4b59-b4c9-6f9536720959. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:19:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-5cecc3a8-4c89-4b5b-9a51-9abe1a05dc70 req-4958a821-fdb3-43c2-b581-c9b30652532f service nova] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:19:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:19:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:19:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:19:59 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:19:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:19:59 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:19:59 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:19:59 user nova-compute[74934]: INFO nova.compute.claims [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Claim successful on node user
Nov 19 15:19:59 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:20:00 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.policy [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ade11c889684ca9b402fa1066e4b629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441622bd90c1460fb78ac8ebdbead719', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:20:00 user nova-compute[74934]: INFO nova.virt.block_device [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Booting with volume 5158b006-1154-4509-988c-589e928d63f8 at /dev/vda
Nov 19 15:20:00 user nova-compute[74934]: DEBUG os_brick.utils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98df62-d6e3-4814-8e8d-760d23e9d729]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[583229fd-22c2-4d16-bab6-4246d0665574]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09aa0fc-34e9-4da6-917f-c5d21dafc13e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b3634-1fc9-4b41-a757-e0f4caa95dfa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:20:00 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:20:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ef2a4-877a-400a-8e25-b21475f05b57]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG os_brick.utils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating existing volume attachment record: 821ab7fc-5297-4b89-8f3d-e4976995c3ee {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:20:00 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Successfully created port: 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Successfully updated port: 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquired lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-changed-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.compute.manager [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Refreshing instance network info cache due to event network-changed-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] Acquiring lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.network.neutron [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating instance_info_cache with network_info: [{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Releasing lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Instance network_info: |[{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] Acquired lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:20:01 user nova-compute[74934]: DEBUG nova.network.neutron [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Refreshing network info cache for port 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:20:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updated VIF entry in instance network info cache for port 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:20:02 user nova-compute[74934]: DEBUG nova.network.neutron [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating instance_info_cache with network_info: [{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:20:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4e9e931e-d07a-4968-a55c-a5e52372af38 req-b984f132-29b7-4675-a84a-ca16abf2995f service nova] Releasing lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:20:05 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Creating image(s)
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Did not create local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Ensure instance console log exists: /opt/stack/data/nova/instances/ad49ed07-b9ba-4f29-b013-0bcbefdb4233/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Start _get_guest_xml network_info=[{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'attachment_id': '821ab7fc-5297-4b89-8f3d-e4976995c3ee', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUYbIknt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad49ed07-b9ba-4f29-b013-0bcbefdb4233', 'attached_at': '', 'detached_at': '', 'volume_id': '5158b006-1154-4509-988c-589e928d63f8', 'serial': '5158b006-1154-4509-988c-589e928d63f8'}, 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:20:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:20:05 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUYbIknt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:20:05 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:20:05 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:20:05 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a5b221-2e8e-468f-b5a6-5e0c304cddce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:20:05 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[774173ac-eafb-49be-b415-935bf84dc666]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8] added
Nov 19 15:20:05 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2633948d-ae82-407d-a774-7a06a93c6a94]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce26865-b59f-4067-ba73-ac068f7a449e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:05 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUYbIknt {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUYbIknt" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027667a-bc5c-404e-b686-79bcec9c779a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUYbIknt'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f6627-2fb0-4733-b730-ff3086d79c67]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9869bf17-e523-46e3-ba6d-1f8c5923a023]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:20:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:20:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b851d-e13a-4578-8c09-04ef4a273692]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260]
Nov 19 15:20:06 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260] successful.
Nov 19 15:20:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da460cb-9c98-4d0c-8700-7bbc19397eca]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb8c83-2080-4329-927f-8207950015e7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:20:06 user nova-compute[74934]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 (non-flash)
Nov 19 15:20:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:20:06 user nova-compute[74934]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 (non-flash)
Nov 19 15:20:06 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[30063983-aabc-4334-8eaf-4681ade8160a]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:20:06 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUYbIknt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23866393430306231', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866393430306231', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1309808528',display_name='tempest-TestVolumeBootPattern-server-1309808528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1309808528',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-5teghank',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:20:00Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=ad49ed07-b9ba-4f29-b013-0bcbefdb4233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'pci_devices' on Instance uuid ad49ed07-b9ba-4f29-b013-0bcbefdb4233 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:20:07 user nova-compute[74934]:   <uuid>ad49ed07-b9ba-4f29-b013-0bcbefdb4233</uuid>
Nov 19 15:20:07 user nova-compute[74934]:   <name>instance-00000033</name>
Nov 19 15:20:07 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:20:07 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:20:07 user nova-compute[74934]:   <metadata>
Nov 19 15:20:07 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:20:07 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:20:07 user nova-compute[74934]:       <nova:name>tempest-TestVolumeBootPattern-server-1309808528</nova:name>
Nov 19 15:20:07 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:20:05</nova:creationTime>
Nov 19 15:20:07 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:20:07 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:20:07 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:20:07 user nova-compute[74934]:       <nova:owner>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:user uuid="3ade11c889684ca9b402fa1066e4b629">tempest-TestVolumeBootPattern-686579107-project-member</nova:user>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:project uuid="441622bd90c1460fb78ac8ebdbead719">tempest-TestVolumeBootPattern-686579107</nova:project>
Nov 19 15:20:07 user nova-compute[74934]:       </nova:owner>
Nov 19 15:20:07 user nova-compute[74934]:       <nova:ports>
Nov 19 15:20:07 user nova-compute[74934]:         <nova:port uuid="43ac65bc-3a0c-4c42-ac07-379a4f84eaf2">
Nov 19 15:20:07 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 19 15:20:07 user nova-compute[74934]:         </nova:port>
Nov 19 15:20:07 user nova-compute[74934]:       </nova:ports>
Nov 19 15:20:07 user nova-compute[74934]:     </nova:instance>
Nov 19 15:20:07 user nova-compute[74934]:   </metadata>
Nov 19 15:20:07 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:20:07 user nova-compute[74934]:     <system>
Nov 19 15:20:07 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:20:07 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:20:07 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:20:07 user nova-compute[74934]:       <entry name="serial">ad49ed07-b9ba-4f29-b013-0bcbefdb4233</entry>
Nov 19 15:20:07 user nova-compute[74934]:       <entry name="uuid">ad49ed07-b9ba-4f29-b013-0bcbefdb4233</entry>
Nov 19 15:20:07 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:20:07 user nova-compute[74934]:     </system>
Nov 19 15:20:07 user nova-compute[74934]:   </sysinfo>
Nov 19 15:20:07 user nova-compute[74934]:   <os>
Nov 19 15:20:07 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:20:07 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:20:07 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:20:07 user nova-compute[74934]:   </os>
Nov 19 15:20:07 user nova-compute[74934]:   <features>
Nov 19 15:20:07 user nova-compute[74934]:     <acpi/>
Nov 19 15:20:07 user nova-compute[74934]:     <apic/>
Nov 19 15:20:07 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:20:07 user nova-compute[74934]:   </features>
Nov 19 15:20:07 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:20:07 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:20:07 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:20:07 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:20:07 user nova-compute[74934]:   </clock>
Nov 19 15:20:07 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:20:07 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:20:07 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:20:07 user nova-compute[74934]:   </cpu>
Nov 19 15:20:07 user nova-compute[74934]:   <devices>
Nov 19 15:20:07 user nova-compute[74934]:     <disk type="block" device="disk">
Nov 19 15:20:07 user nova-compute[74934]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:20:07 user nova-compute[74934]:       <source dev="/dev/sdb"/>
Nov 19 15:20:07 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:20:07 user nova-compute[74934]:       <serial>5158b006-1154-4509-988c-589e928d63f8</serial>
Nov 19 15:20:07 user nova-compute[74934]:     </disk>
Nov 19 15:20:07 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:20:07 user nova-compute[74934]:       <mac address="fa:16:3e:36:eb:b7"/>
Nov 19 15:20:07 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:20:07 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:20:07 user nova-compute[74934]:       <target dev="tap43ac65bc-3a"/>
Nov 19 15:20:07 user nova-compute[74934]:     </interface>
Nov 19 15:20:07 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:20:07 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/ad49ed07-b9ba-4f29-b013-0bcbefdb4233/console.log" append="off"/>
Nov 19 15:20:07 user nova-compute[74934]:     </serial>
Nov 19 15:20:07 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:20:07 user nova-compute[74934]:     <video>
Nov 19 15:20:07 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:20:07 user nova-compute[74934]:     </video>
Nov 19 15:20:07 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:20:07 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:20:07 user nova-compute[74934]:     </rng>
Nov 19 15:20:07 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:20:07 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:20:07 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:20:07 user nova-compute[74934]:     </memballoon>
Nov 19 15:20:07 user nova-compute[74934]:   </devices>
Nov 19 15:20:07 user nova-compute[74934]: </domain>
Nov 19 15:20:07 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1309808528',display_name='tempest-TestVolumeBootPattern-server-1309808528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1309808528',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-5teghank',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:20:00Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=ad49ed07-b9ba-4f29-b013-0bcbefdb4233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG os_vif [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3333f52e-e5f9-58fe-ba40-c82ffcb227c6', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43ac65bc-3a, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43ac65bc-3a, col_values=(('qos', UUID('181a4e0b-b4f6-4f91-8f4b-1118a8fbdf6d')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43ac65bc-3a, col_values=(('external_ids', {'iface-id': '43ac65bc-3a0c-4c42-ac07-379a4f84eaf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:eb:b7', 'vm-uuid': 'ad49ed07-b9ba-4f29-b013-0bcbefdb4233'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:07 user nova-compute[74934]: INFO os_vif [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a')
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:20:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] No VIF found with MAC fa:16:3e:36:eb:b7, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d97de76-a457-4a9f-a9a7-c824bf9d8510 req-08321085-c47c-489e-9477-a4e831e6c2d2 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d97de76-a457-4a9f-a9a7-c824bf9d8510 req-08321085-c47c-489e-9477-a4e831e6c2d2 service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d97de76-a457-4a9f-a9a7-c824bf9d8510 req-08321085-c47c-489e-9477-a4e831e6c2d2 service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3d97de76-a457-4a9f-a9a7-c824bf9d8510 req-08321085-c47c-489e-9477-a4e831e6c2d2 service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-3d97de76-a457-4a9f-a9a7-c824bf9d8510 req-08321085-c47c-489e-9477-a4e831e6c2d2 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:20:08 user nova-compute[74934]: WARNING nova.compute.manager [req-3d97de76-a457-4a9f-a9a7-c824bf9d8510 req-08321085-c47c-489e-9477-a4e831e6c2d2 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received unexpected event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with vm_state building and task_state spawning.
Nov 19 15:20:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:20:10 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Instance spawned successfully.
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:20:10 user nova-compute[74934]: INFO nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-41d04de6-f28b-47a0-a974-7da461abf5d5 req-1be4bc38-8401-461f-8ce0-34c6b0d9f23e service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-41d04de6-f28b-47a0-a974-7da461abf5d5 req-1be4bc38-8401-461f-8ce0-34c6b0d9f23e service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-41d04de6-f28b-47a0-a974-7da461abf5d5 req-1be4bc38-8401-461f-8ce0-34c6b0d9f23e service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-41d04de6-f28b-47a0-a974-7da461abf5d5 req-1be4bc38-8401-461f-8ce0-34c6b0d9f23e service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:10 user nova-compute[74934]: DEBUG nova.compute.manager [req-41d04de6-f28b-47a0-a974-7da461abf5d5 req-1be4bc38-8401-461f-8ce0-34c6b0d9f23e service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:20:10 user nova-compute[74934]: WARNING nova.compute.manager [req-41d04de6-f28b-47a0-a974-7da461abf5d5 req-1be4bc38-8401-461f-8ce0-34c6b0d9f23e service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received unexpected event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with vm_state building and task_state spawning.
Nov 19 15:20:10 user nova-compute[74934]: INFO nova.compute.manager [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Took 10.97 seconds to build instance.
Nov 19 15:20:10 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0def0743-0c54-4f15-b3f3-c4e011d51af0 tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.065s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid bbf746eb-6733-46ff-982a-c281906f5622 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:20:16 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:20:16 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:20:16 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.114620208740234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:20:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bbf746eb-6733-46ff-982a-c281906f5622 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ad49ed07-b9ba-4f29-b013-0bcbefdb4233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:20:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:20:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:20:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:20:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:20:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:20:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:20:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:20:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:20:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:20:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:20:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:20:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:20:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:21:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:09 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:21:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating instance_info_cache with network_info: [{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:21:16 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:21:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:21:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:21:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:21:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.113971710205078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bbf746eb-6733-46ff-982a-c281906f5622 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance ad49ed07-b9ba-4f29-b013-0bcbefdb4233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:21:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:21:19 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:21:19 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:21:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:21:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:21:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:21:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:21:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:21:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-changed-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Refreshing instance network info cache due to event network-changed-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:21:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] Acquiring lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:21:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] Acquired lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:21:51 user nova-compute[74934]: DEBUG nova.network.neutron [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Refreshing network info cache for port 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG nova.network.neutron [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updated VIF entry in instance network info cache for port 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG nova.network.neutron [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating instance_info_cache with network_info: [{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1a103c0f-a144-41d2-9959-123efb426f48 req-da4b4834-8fc2-41c3-b081-37bc5fe912a7 service nova] Releasing lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:52 user nova-compute[74934]: INFO nova.compute.manager [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Terminating instance
Nov 19 15:21:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-6a6b8eee-67f0-404d-a4fa-9f7fb954e301 req-a22e54ba-8d1b-4495-991a-61ff09bdf2d2 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-unplugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6a6b8eee-67f0-404d-a4fa-9f7fb954e301 req-a22e54ba-8d1b-4495-991a-61ff09bdf2d2 service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6a6b8eee-67f0-404d-a4fa-9f7fb954e301 req-a22e54ba-8d1b-4495-991a-61ff09bdf2d2 service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-6a6b8eee-67f0-404d-a4fa-9f7fb954e301 req-a22e54ba-8d1b-4495-991a-61ff09bdf2d2 service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-6a6b8eee-67f0-404d-a4fa-9f7fb954e301 req-a22e54ba-8d1b-4495-991a-61ff09bdf2d2 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-unplugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG nova.compute.manager [req-6a6b8eee-67f0-404d-a4fa-9f7fb954e301 req-a22e54ba-8d1b-4495-991a-61ff09bdf2d2 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-unplugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Instance destroyed successfully.
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'resources' on Instance uuid ad49ed07-b9ba-4f29-b013-0bcbefdb4233 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1309808528',display_name='tempest-TestVolumeBootPattern-server-1309808528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1309808528',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-5teghank',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:20:11Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=ad49ed07-b9ba-4f29-b013-0bcbefdb4233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_vif [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43ac65bc-3a, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=181a4e0b-b4f6-4f91-8f4b-1118a8fbdf6d) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:21:53 user nova-compute[74934]: INFO os_vif [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:eb:b7,bridge_name='br-int',has_traffic_filtering=True,id=43ac65bc-3a0c-4c42-ac07-379a4f84eaf2,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43ac65bc-3a')
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUYbIknt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:21:53 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ac3a76-7cd5-4b29-b54c-712ed37d2954]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:21:53 user nova-compute[74934]: No targets found.
Nov 19 15:21:53 user nova-compute[74934]: iSNS:
Nov 19 15:21:53 user nova-compute[74934]: No targets found.
Nov 19 15:21:53 user nova-compute[74934]: STATIC:
Nov 19 15:21:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07
Nov 19 15:21:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:21:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:21:53 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8
Nov 19 15:21:53 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:21:53 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:21:53 user nova-compute[74934]: FIRMWARE:
Nov 19 15:21:53 user nova-compute[74934]: No targets found.
Nov 19 15:21:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:21:53 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:21:53 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[927b97b9-61a2-4be2-821d-0ad62a92e7e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20674aa-2f21-4c01-878c-4014671b94f1]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:21:53 user nova-compute[74934]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 (non-flash)
Nov 19 15:21:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:21:53 user nova-compute[74934]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 (non-flash)
Nov 19 15:21:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4243a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e119aa-6774-4cd7-b240-fe4e9ef7fac4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[927bfa45-7eb1-488f-a209-b0016ad25214]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce6553-6034-4452-97aa-6ccbac671ed8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-changed-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.compute.manager [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Refreshing instance network info cache due to event network-changed-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] Acquiring lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] Acquired lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.network.neutron [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Refreshing network info cache for port 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6317be79-24a8-4fe3-a93b-548d0452347e]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ad0820e8', '/dev/disk/by-id/scsi-1SCST_BIOad0820e8-8f9400b121fc1bd5', '/dev/disk/by-id/scsi-23866393430306231') {{(pid=86319) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf613ea-2674-4062-8f7c-b1d395ee7c1d]: (4, None) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[272bc659-ac78-4832-9481-caf804c0a502]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f297a-701b-4550-a35e-43bdd8a4cb83]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260]
Nov 19 15:21:53 user nova-compute[74934]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8, portal: 172.16.0.220,3260] successful.
Nov 19 15:21:53 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5158b006-1154-4509-988c-589e928d63f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e35af62-e184-47a2-8f54-eb5cf274da78]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== disconnect_volume: return (318ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:21:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Deleting instance files /opt/stack/data/nova/instances/ad49ed07-b9ba-4f29-b013-0bcbefdb4233_del
Nov 19 15:21:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Deletion of /opt/stack/data/nova/instances/ad49ed07-b9ba-4f29-b013-0bcbefdb4233_del complete
Nov 19 15:21:53 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:53 user nova-compute[74934]: INFO nova.compute.manager [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 19 15:21:53 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:21:53 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.network.neutron [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updated VIF entry in instance network info cache for port 43ac65bc-3a0c-4c42-ac07-379a4f84eaf2. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.network.neutron [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating instance_info_cache with network_info: [{"id": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "address": "fa:16:3e:36:eb:b7", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43ac65bc-3a", "ovs_interfaceid": "43ac65bc-3a0c-4c42-ac07-379a4f84eaf2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-279c4c58-fd2b-41c5-a473-b55a7748f031 req-24fdf4e9-0fcd-4571-acea-23ac7fac73b4 service nova] Releasing lock "refresh_cache-ad49ed07-b9ba-4f29-b013-0bcbefdb4233" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:21:54 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Took 0.69 seconds to deallocate network for instance.
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-592838fb-62a0-453b-a4bc-e84c0af843ac req-e5963879-31d1-4ea9-8175-620a1c772d2c service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-deleted-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:21:54 user nova-compute[74934]: WARNING nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received unexpected event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with vm_state active and task_state deleting.
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:21:54 user nova-compute[74934]: WARNING nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received unexpected event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with vm_state active and task_state deleting.
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:21:54 user nova-compute[74934]: WARNING nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received unexpected event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with vm_state active and task_state deleting.
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-unplugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-unplugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-unplugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Acquiring lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] No waiting events found dispatching network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:21:54 user nova-compute[74934]: WARNING nova.compute.manager [req-53ff1d32-4c14-4099-ad01-8664064f1f6d req-1b7cd409-444d-4f5d-b208-f7217db0229d service nova] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Received unexpected event network-vif-plugged-43ac65bc-3a0c-4c42-ac07-379a4f84eaf2 for instance with vm_state active and task_state deleting.
Nov 19 15:21:55 user nova-compute[74934]: INFO nova.compute.manager [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: ad49ed07-b9ba-4f29-b013-0bcbefdb4233] Took 0.74 seconds to detach 1 volumes for instance.
Nov 19 15:21:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:21:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:21:55 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:21:55 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:21:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:55 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Deleted allocations for instance ad49ed07-b9ba-4f29-b013-0bcbefdb4233
Nov 19 15:21:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-1700bd5c-6fb7-460d-b140-496d644882ca tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "ad49ed07-b9ba-4f29-b013-0bcbefdb4233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:21:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:21:58 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:22:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:08 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:10 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:22:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid bbf746eb-6733-46ff-982a-c281906f5622 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74934) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 19 15:22:19 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:22:19 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9058MB free_disk=25.11301040649414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance bbf746eb-6733-46ff-982a-c281906f5622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:22:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:23 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:22:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:22:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:28 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:22:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:22:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:22:43 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:48 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-changed-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:22:48 user nova-compute[74934]: DEBUG nova.compute.manager [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Refreshing instance network info cache due to event network-changed-ee09c339-6a43-4b59-b4c9-6f9536720959. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:22:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] Acquiring lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:22:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] Acquired lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:22:48 user nova-compute[74934]: DEBUG nova.network.neutron [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Refreshing network info cache for port ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "bbf746eb-6733-46ff-982a-c281906f5622" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:49 user nova-compute[74934]: INFO nova.compute.manager [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Terminating instance
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.compute.manager [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updated VIF entry in instance network info cache for port ee09c339-6a43-4b59-b4c9-6f9536720959. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.network.neutron [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [{"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-613adf0a-09ef-46a9-a1a0-af1d3ce66f6c req-9dac5d51-2b21-4fbf-8e36-51ac5c3ec9ca service nova] Releasing lock "refresh_cache-bbf746eb-6733-46ff-982a-c281906f5622" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-7fbca1ff-af38-4d56-9991-d4d3b0b30b02 req-8e820e8a-6630-4625-bdde-70843a9503ad service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-vif-unplugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7fbca1ff-af38-4d56-9991-d4d3b0b30b02 req-8e820e8a-6630-4625-bdde-70843a9503ad service nova] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7fbca1ff-af38-4d56-9991-d4d3b0b30b02 req-8e820e8a-6630-4625-bdde-70843a9503ad service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-7fbca1ff-af38-4d56-9991-d4d3b0b30b02 req-8e820e8a-6630-4625-bdde-70843a9503ad service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-7fbca1ff-af38-4d56-9991-d4d3b0b30b02 req-8e820e8a-6630-4625-bdde-70843a9503ad service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] No waiting events found dispatching network-vif-unplugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-7fbca1ff-af38-4d56-9991-d4d3b0b30b02 req-8e820e8a-6630-4625-bdde-70843a9503ad service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-vif-unplugged-ee09c339-6a43-4b59-b4c9-6f9536720959 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Instance destroyed successfully.
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.objects.instance [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lazy-loading 'resources' on Instance uuid bbf746eb-6733-46ff-982a-c281906f5622 {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:18:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-898720729',display_name='tempest-TestVolumeBootPattern-server-898720729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-898720729',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqU/kb4k9Bjm2Vu4rDpEeCjiRCgsYgYtchSHh9drGmKeA1uPFFd9LKZfSM8iaC6fUfVIjhRvFTMJrGhpvORVJYZeKlshM8kT7Lw1d1eKW+MOSnPgYQnxS7KyCQH4NmHsA==',key_name='tempest-TestVolumeBootPattern-177829372',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='441622bd90c1460fb78ac8ebdbead719',ramdisk_id='',reservation_id='r-h64ojljf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-686579107',owner_user_name='tempest-TestVolumeBootPattern-686579107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:18:13Z,user_data=None,user_id='3ade11c889684ca9b402fa1066e4b629',uuid=bbf746eb-6733-46ff-982a-c281906f5622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converting VIF {"id": "ee09c339-6a43-4b59-b4c9-6f9536720959", "address": "fa:16:3e:32:ad:ac", "network": {"id": "7def1005-4b10-454b-a897-14d208303662", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1037296163-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "441622bd90c1460fb78ac8ebdbead719", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee09c339-6a", "ovs_interfaceid": "ee09c339-6a43-4b59-b4c9-6f9536720959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_vif [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee09c339-6a, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bcde45b-d22e-40e6-bb16-48b0d2645346) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:22:49 user nova-compute[74934]: INFO os_vif [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:ad:ac,bridge_name='br-int',has_traffic_filtering=True,id=ee09c339-6a43-4b59-b4c9-6f9536720959,network=Network(7def1005-4b10-454b-a897-14d208303662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee09c339-6a')
Nov 19 15:22:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWzVfhjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:22:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e6bea-ca85-4485-bc6d-36dfac8d49ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:22:49 user nova-compute[74934]: No targets found.
Nov 19 15:22:49 user nova-compute[74934]: iSNS:
Nov 19 15:22:49 user nova-compute[74934]: No targets found.
Nov 19 15:22:49 user nova-compute[74934]: STATIC:
Nov 19 15:22:49 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07
Nov 19 15:22:49 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:22:49 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:22:49 user nova-compute[74934]: FIRMWARE:
Nov 19 15:22:49 user nova-compute[74934]: No targets found.
Nov 19 15:22:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:22:49 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:22:49 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b926dca2-822e-4d67-b61b-36e0f7dc4d19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[22176a26-37b0-47e1-b033-e4e135dcfa3f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:22:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 (non-flash)
Nov 19 15:22:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4299870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07'): ({'sdc'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Removing single pathed devices sdc {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7443f0e-382e-4c9c-b73e-66c3a2f4d460]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6b78a-c2dd-4a1e-ab11-62396723beff]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Flushing IO for device /dev/sdc {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[603fc680-e295-46a9-a9f1-1ba1116619b9]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:22:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcfb709-5ab9-4ec2-992a-c6b326e4e40f]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] SCSI volumes sdc have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70604e15-915b-4d0f-b397-9d40b2e81785]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7864299-c1ee-4496-811d-50a03f856f01]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260]
Nov 19 15:22:50 user nova-compute[74934]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07, portal: 172.16.0.220,3260] successful.
Nov 19 15:22:50 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:533b04f4-6fe6-4052-a997-cecf3c3dad07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4fa5df-0341-49f2-acfa-1938098b7210]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] <== disconnect_volume: return (288ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:22:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Deleting instance files /opt/stack/data/nova/instances/bbf746eb-6733-46ff-982a-c281906f5622_del
Nov 19 15:22:50 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Deletion of /opt/stack/data/nova/instances/bbf746eb-6733-46ff-982a-c281906f5622_del complete
Nov 19 15:22:50 user nova-compute[74934]: INFO nova.compute.manager [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 19 15:22:50 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: bbf746eb-6733-46ff-982a-c281906f5622] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:50 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:22:50 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Took 0.50 seconds to deallocate network for instance.
Nov 19 15:22:50 user nova-compute[74934]: DEBUG nova.compute.manager [req-ac10ea06-66d2-49bd-bad8-050d897b185d req-9f07e456-aec1-48fc-8209-84bb7fcc21f1 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-vif-deleted-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:22:51 user nova-compute[74934]: INFO nova.compute.manager [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Took 0.86 seconds to detach 1 volumes for instance.
Nov 19 15:22:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-85557160-16b3-47e3-89cb-f5970cc16f39 req-c944cc1f-cb47-448b-9d1e-5545aa9d5eb0 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received event network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85557160-16b3-47e3-89cb-f5970cc16f39 req-c944cc1f-cb47-448b-9d1e-5545aa9d5eb0 service nova] Acquiring lock "bbf746eb-6733-46ff-982a-c281906f5622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85557160-16b3-47e3-89cb-f5970cc16f39 req-c944cc1f-cb47-448b-9d1e-5545aa9d5eb0 service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-85557160-16b3-47e3-89cb-f5970cc16f39 req-c944cc1f-cb47-448b-9d1e-5545aa9d5eb0 service nova] Lock "bbf746eb-6733-46ff-982a-c281906f5622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-85557160-16b3-47e3-89cb-f5970cc16f39 req-c944cc1f-cb47-448b-9d1e-5545aa9d5eb0 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] No waiting events found dispatching network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:22:51 user nova-compute[74934]: WARNING nova.compute.manager [req-85557160-16b3-47e3-89cb-f5970cc16f39 req-c944cc1f-cb47-448b-9d1e-5545aa9d5eb0 service nova] [instance: bbf746eb-6733-46ff-982a-c281906f5622] Received unexpected event network-vif-plugged-ee09c339-6a43-4b59-b4c9-6f9536720959 for instance with vm_state active and task_state deleting.
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:51 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Deleted allocations for instance bbf746eb-6733-46ff-982a-c281906f5622
Nov 19 15:22:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-eff72365-1d7b-4141-85e8-e06018eec1dc tempest-TestVolumeBootPattern-686579107 tempest-TestVolumeBootPattern-686579107-project-member] Lock "bbf746eb-6733-46ff-982a-c281906f5622" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.851s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:22:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:22:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:11 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:15 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:23:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:23:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:23:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9156MB free_disk=25.11208724975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:23:18 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:23:19 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:23:19 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:23:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:23:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:23:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:23:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:23:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:23:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:23:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:23:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Verify base images {{(pid=74934) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b
Nov 19 15:23:44 user nova-compute[74934]: WARNING nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Unknown base file: /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Removable base files: /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2 /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954 /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/56e3598c05011ec627daf4f8ff945cdc6690ed8a
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9fb27858861f73099b4f5c369cb7f74dd23b55ab
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c743c33ec423c6a3c373fd04d398021af29251e2
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8c7035f2f5bffcc99e9f8b78bf6cce7d58d375e
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c183e2f198d6c8631652080d1ec75f5a37cdd28d
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/814c517469b2dfe4bf697833ad1e75067b463954
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d83f0421bce8e3e39820db43d3a6707c01c961cc
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da9de182a4edca08dcfa3eb462c7be8a959c6d3b
Nov 19 15:23:44 user nova-compute[74934]: INFO nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9e23a6a8b3a3facf236435b532ca84df1a1be7ca
Nov 19 15:23:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Verification complete {{(pid=74934) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Verify swap images {{(pid=74934) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG nova.virt.libvirt.imagecache [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Verify ephemeral images {{(pid=74934) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 19 15:23:44 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:49 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:23:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:54 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:23:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:23:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:23:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:23:59 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:04 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:09 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:24:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:24:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:24:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:17 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:24:19 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:24:19 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9180MB free_disk=25.102352142333984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:24:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:24:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:24:20 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:24:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:24:24 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:25 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:24:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:29 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:34 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:37 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:24:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:37 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:37 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:24:37 user nova-compute[74934]: INFO nova.compute.claims [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Claim successful on node user
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:24:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.policy [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b11cc77648694d1b91e5d6818ae2219d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed82dfd14f44783bc2461b7eebcfc76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:24:38 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Creating image(s)
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "/opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "/opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.171s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.168s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk 1073741824" returned: 0 in 0.049s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:24:38 user nova-compute[74934]: DEBUG nova.network.neutron [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Successfully created port: 2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Cannot resize image /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Ensure instance console log exists: /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Successfully updated port: 2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-changed-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.compute.manager [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Refreshing instance network info cache due to event network-changed-2f60e58c-1ab5-4b4a-8875-86bd99498044. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:24:39 user nova-compute[74934]: DEBUG nova.network.neutron [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.neutron [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Instance network_info: |[{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.neutron [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Refreshing network info cache for port 2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Start _get_guest_xml network_info=[{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:24:40 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:24:40 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-139685677',display_name='tempest-SnapshotDataIntegrityTests-server-139685677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-139685677',id=52,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtfP6RlaYOMiHCHbv7o3JrHSeER7mZiZPfq2jk/oGTh/DlIow/80e7H3l+Y9bT83hfiNrqMqZMas6U/8ScgIRGKDet3pT52zLfFQyii3/wMbcz6KXpAV2Ks4s2ZAMxR6Q==',key_name='tempest-keypair-272501707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed82dfd14f44783bc2461b7eebcfc76',ramdisk_id='',reservation_id='r-rkyzyuth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-406787885',owner_user_name='tempest-SnapshotDataIntegrityTests-406787885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b11cc77648694d1b91e5d6818ae2219d',uuid=7fe2aebd-c51f-4bb9-801c-746dc3ac003f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Converting VIF {"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.objects.instance [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:24:40 user nova-compute[74934]:   <uuid>7fe2aebd-c51f-4bb9-801c-746dc3ac003f</uuid>
Nov 19 15:24:40 user nova-compute[74934]:   <name>instance-00000034</name>
Nov 19 15:24:40 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:24:40 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:24:40 user nova-compute[74934]:   <metadata>
Nov 19 15:24:40 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:24:40 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:24:40 user nova-compute[74934]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-139685677</nova:name>
Nov 19 15:24:40 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:24:40</nova:creationTime>
Nov 19 15:24:40 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:24:40 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:24:40 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:24:40 user nova-compute[74934]:       <nova:owner>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:user uuid="b11cc77648694d1b91e5d6818ae2219d">tempest-SnapshotDataIntegrityTests-406787885-project-member</nova:user>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:project uuid="7ed82dfd14f44783bc2461b7eebcfc76">tempest-SnapshotDataIntegrityTests-406787885</nova:project>
Nov 19 15:24:40 user nova-compute[74934]:       </nova:owner>
Nov 19 15:24:40 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:24:40 user nova-compute[74934]:       <nova:ports>
Nov 19 15:24:40 user nova-compute[74934]:         <nova:port uuid="2f60e58c-1ab5-4b4a-8875-86bd99498044">
Nov 19 15:24:40 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 19 15:24:40 user nova-compute[74934]:         </nova:port>
Nov 19 15:24:40 user nova-compute[74934]:       </nova:ports>
Nov 19 15:24:40 user nova-compute[74934]:     </nova:instance>
Nov 19 15:24:40 user nova-compute[74934]:   </metadata>
Nov 19 15:24:40 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:24:40 user nova-compute[74934]:     <system>
Nov 19 15:24:40 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:24:40 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:24:40 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:24:40 user nova-compute[74934]:       <entry name="serial">7fe2aebd-c51f-4bb9-801c-746dc3ac003f</entry>
Nov 19 15:24:40 user nova-compute[74934]:       <entry name="uuid">7fe2aebd-c51f-4bb9-801c-746dc3ac003f</entry>
Nov 19 15:24:40 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:24:40 user nova-compute[74934]:     </system>
Nov 19 15:24:40 user nova-compute[74934]:   </sysinfo>
Nov 19 15:24:40 user nova-compute[74934]:   <os>
Nov 19 15:24:40 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:24:40 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:24:40 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:24:40 user nova-compute[74934]:   </os>
Nov 19 15:24:40 user nova-compute[74934]:   <features>
Nov 19 15:24:40 user nova-compute[74934]:     <acpi/>
Nov 19 15:24:40 user nova-compute[74934]:     <apic/>
Nov 19 15:24:40 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:24:40 user nova-compute[74934]:   </features>
Nov 19 15:24:40 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:24:40 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:24:40 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:24:40 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:24:40 user nova-compute[74934]:   </clock>
Nov 19 15:24:40 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:24:40 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:24:40 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:24:40 user nova-compute[74934]:   </cpu>
Nov 19 15:24:40 user nova-compute[74934]:   <devices>
Nov 19 15:24:40 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:24:40 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:24:40 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk"/>
Nov 19 15:24:40 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:24:40 user nova-compute[74934]:     </disk>
Nov 19 15:24:40 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:24:40 user nova-compute[74934]:       <mac address="fa:16:3e:01:b1:7a"/>
Nov 19 15:24:40 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:24:40 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:24:40 user nova-compute[74934]:       <target dev="tap2f60e58c-1a"/>
Nov 19 15:24:40 user nova-compute[74934]:     </interface>
Nov 19 15:24:40 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:24:40 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/console.log" append="off"/>
Nov 19 15:24:40 user nova-compute[74934]:     </serial>
Nov 19 15:24:40 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:24:40 user nova-compute[74934]:     <video>
Nov 19 15:24:40 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:24:40 user nova-compute[74934]:     </video>
Nov 19 15:24:40 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:24:40 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:24:40 user nova-compute[74934]:     </rng>
Nov 19 15:24:40 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:24:40 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:24:40 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:24:40 user nova-compute[74934]:     </memballoon>
Nov 19 15:24:40 user nova-compute[74934]:   </devices>
Nov 19 15:24:40 user nova-compute[74934]: </domain>
Nov 19 15:24:40 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-139685677',display_name='tempest-SnapshotDataIntegrityTests-server-139685677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-139685677',id=52,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtfP6RlaYOMiHCHbv7o3JrHSeER7mZiZPfq2jk/oGTh/DlIow/80e7H3l+Y9bT83hfiNrqMqZMas6U/8ScgIRGKDet3pT52zLfFQyii3/wMbcz6KXpAV2Ks4s2ZAMxR6Q==',key_name='tempest-keypair-272501707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ed82dfd14f44783bc2461b7eebcfc76',ramdisk_id='',reservation_id='r-rkyzyuth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-406787885',owner_user_name='tempest-SnapshotDataIntegrityTests-406787885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b11cc77648694d1b91e5d6818ae2219d',uuid=7fe2aebd-c51f-4bb9-801c-746dc3ac003f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Converting VIF {"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG os_vif [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5addda4b-2c1b-5927-8e8f-4136bcb0a91d', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f60e58c-1a, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f60e58c-1a, col_values=(('qos', UUID('915881c9-17a5-474f-b010-af96e2078da7')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f60e58c-1a, col_values=(('external_ids', {'iface-id': '2f60e58c-1ab5-4b4a-8875-86bd99498044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:b1:7a', 'vm-uuid': '7fe2aebd-c51f-4bb9-801c-746dc3ac003f'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:40 user nova-compute[74934]: INFO os_vif [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a')
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No VIF found with MAC fa:16:3e:01:b1:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.neutron [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated VIF entry in instance network info cache for port 2f60e58c-1ab5-4b4a-8875-86bd99498044. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG nova.network.neutron [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:24:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-4ccd1651-c472-4371-88ed-bd685ba038b4 req-8785e770-c29a-4130-9801-407a23dc63d3 service nova] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-bea726a0-cab5-442f-8de9-07e6b4e2adaa req-bb64e9e8-8070-4029-bf39-39fd663684c8 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bea726a0-cab5-442f-8de9-07e6b4e2adaa req-bb64e9e8-8070-4029-bf39-39fd663684c8 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bea726a0-cab5-442f-8de9-07e6b4e2adaa req-bb64e9e8-8070-4029-bf39-39fd663684c8 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-bea726a0-cab5-442f-8de9-07e6b4e2adaa req-bb64e9e8-8070-4029-bf39-39fd663684c8 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:41 user nova-compute[74934]: DEBUG nova.compute.manager [req-bea726a0-cab5-442f-8de9-07e6b4e2adaa req-bb64e9e8-8070-4029-bf39-39fd663684c8 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:24:41 user nova-compute[74934]: WARNING nova.compute.manager [req-bea726a0-cab5-442f-8de9-07e6b4e2adaa req-bb64e9e8-8070-4029-bf39-39fd663684c8 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state building and task_state spawning.
Nov 19 15:24:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:24:43 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Instance spawned successfully.
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:24:43 user nova-compute[74934]: INFO nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-49c8f822-fbbb-48f8-9a7f-61815c4e30a5 req-5f6dbdeb-edfc-48a5-9dfc-20c37b757d9a service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49c8f822-fbbb-48f8-9a7f-61815c4e30a5 req-5f6dbdeb-edfc-48a5-9dfc-20c37b757d9a service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49c8f822-fbbb-48f8-9a7f-61815c4e30a5 req-5f6dbdeb-edfc-48a5-9dfc-20c37b757d9a service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-49c8f822-fbbb-48f8-9a7f-61815c4e30a5 req-5f6dbdeb-edfc-48a5-9dfc-20c37b757d9a service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:43 user nova-compute[74934]: DEBUG nova.compute.manager [req-49c8f822-fbbb-48f8-9a7f-61815c4e30a5 req-5f6dbdeb-edfc-48a5-9dfc-20c37b757d9a service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:24:43 user nova-compute[74934]: WARNING nova.compute.manager [req-49c8f822-fbbb-48f8-9a7f-61815c4e30a5 req-5f6dbdeb-edfc-48a5-9dfc-20c37b757d9a service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state building and task_state spawning.
Nov 19 15:24:43 user nova-compute[74934]: INFO nova.compute.manager [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Took 6.09 seconds to build instance.
Nov 19 15:24:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-96348446-e1b9-484f-b4d1-89d1f2ecd75f tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.202s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:24:52 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:24:52 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:24:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:24:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:24:52 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:24:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:25:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:25:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:25:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:25:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:12 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:25:20 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:25:21 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:25:21 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9032MB free_disk=25.071693420410156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:25:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:25:22 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:25:23 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:25:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:25:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:25:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:25:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:25:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:25:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:25:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:25:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:25:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:26:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:26:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:26:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:26:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:26:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:26:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:13 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:26:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:26:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:26:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:16 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:19 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:26:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:21 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:22 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:26:22 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=25.071128845214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:26:22 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:26:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:26:24 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:26:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:26:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-changed-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:26:28 user nova-compute[74934]: DEBUG nova.compute.manager [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Refreshing instance network info cache due to event network-changed-2f60e58c-1ab5-4b4a-8875-86bd99498044. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:26:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:26:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:26:28 user nova-compute[74934]: DEBUG nova.network.neutron [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Refreshing network info cache for port 2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:26:29 user nova-compute[74934]: DEBUG nova.network.neutron [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated VIF entry in instance network info cache for port 2f60e58c-1ab5-4b4a-8875-86bd99498044. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:26:29 user nova-compute[74934]: DEBUG nova.network.neutron [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:26:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-d90f42eb-8611-40e8-a0fd-9b4c9b0b4c29 req-74fa3c6d-9fc7-41ce-aba0-3b45548e132c service nova] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:26:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:31 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:26:33 user nova-compute[74934]: INFO nova.compute.manager [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attaching volume fc4b9981-901f-4aa3-9801-98e31f26779a to /dev/vdb
Nov 19 15:26:33 user nova-compute[74934]: DEBUG os_brick.utils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c6c17-a88e-483b-b35b-afa1726ee36f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e17bdc-d327-45fb-81ed-4b2dab08f780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[79730d0a-c48d-4b96-961e-0a002894d034]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9be5ca-abeb-463e-b14f-3b5cd2b3be39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:26:33 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:26:33 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef2a8f-5221-4b7d-9b38-ac851d6dd3c4]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG os_brick.utils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:26:33 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating existing volume attachment record: 11ab6d82-f70e-4196-a08e-5e214cf4b664 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:26:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZwsOWRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:26:38 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:26:38 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:26:38 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63c3075-88c9-47e0-8a97-4f6cdb2506b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:26:38 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f5b43-2a9d-48c8-81bc-720edd87746e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a] added
Nov 19 15:26:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b956b530-4298-43f3-8657-eb15d204a2ef]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fab9c-23d4-4c15-8b91-0a123626ddcb]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZwsOWRJ {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YZwsOWRJ" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf60d26b-9169-46c2-b50e-58c0345d3473]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YZwsOWRJ'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3128dc2-51b9-430e-9cdb-75db1792146a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a09151f-cac1-4f5b-93ba-2969cb59002d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:26:38 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:26:38 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:26:38 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:26:38 user nova-compute[74934]: 
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cd3f5a-b2fa-43a5-8ee5-04140ac5c780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260]
Nov 19 15:26:38 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260] successful.
Nov 19 15:26:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6d93bd-3495-4845-bfcd-4d188ad756c7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7090eb5f-0d6d-4624-83b5-b92d6e7b3567]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a (non-flash)
Nov 19 15:26:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a (non-flash)
Nov 19 15:26:38 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.228s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba64016-8ed8-4917-8712-b779248e23b8]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:26:38 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZwsOWRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:26:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.257s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:26:39 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== connect_volume: return (1258ms) {'type': 'block', 'scsi_wwn': '26365343030626362', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:26:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365343030626362', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:26:39 user nova-compute[74934]: DEBUG nova.objects.instance [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:26:39 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:26:39 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:26:39 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:26:39 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:26:39 user nova-compute[74934]:   <serial>fc4b9981-901f-4aa3-9801-98e31f26779a</serial>
Nov 19 15:26:39 user nova-compute[74934]: </disk>
Nov 19 15:26:39 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:26:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:26:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:26:40 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No VIF found with MAC fa:16:3e:01:b1:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:26:40 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-7ecf5127-88b6-411b-92ae-737cfd4e66c2 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.158s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:26:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:26:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:26:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:26:51 user nova-compute[74934]: INFO nova.compute.manager [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Detaching volume fc4b9981-901f-4aa3-9801-98e31f26779a
Nov 19 15:26:51 user nova-compute[74934]: INFO nova.virt.block_device [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attempting to driver detach volume fc4b9981-901f-4aa3-9801-98e31f26779a from mountpoint /dev/vdb
Nov 19 15:26:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Attempting to detach device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:26:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:26:51 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:26:51 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:26:51 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:26:51 user nova-compute[74934]:   <serial>fc4b9981-901f-4aa3-9801-98e31f26779a</serial>
Nov 19 15:26:51 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:26:51 user nova-compute[74934]: </disk>
Nov 19 15:26:51 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:26:51 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config.
Nov 19 15:26:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:26:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:26:51 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:26:51 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:26:51 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:26:51 user nova-compute[74934]:   <serial>fc4b9981-901f-4aa3-9801-98e31f26779a</serial>
Nov 19 15:26:51 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:26:51 user nova-compute[74934]: </disk>
Nov 19 15:26:51 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:26:52 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:26:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:27:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:12 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f is timed out.
Nov 19 15:27:12 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config.
Nov 19 15:27:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YZwsOWRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:27:12 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fb2fa0-c294-4d8f-b79d-1cc3b12880b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:27:12 user nova-compute[74934]: No targets found.
Nov 19 15:27:12 user nova-compute[74934]: iSNS:
Nov 19 15:27:12 user nova-compute[74934]: No targets found.
Nov 19 15:27:12 user nova-compute[74934]: STATIC:
Nov 19 15:27:12 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a
Nov 19 15:27:12 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:27:12 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:27:12 user nova-compute[74934]: FIRMWARE:
Nov 19 15:27:12 user nova-compute[74934]: No targets found.
Nov 19 15:27:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:27:12 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:27:12 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307de4e-eef2-4e41-87a3-54afe042b8f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b49eb-88f5-4897-a1e4-1d519e72cdb0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a (non-flash)
Nov 19 15:27:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a (non-flash)
Nov 19 15:27:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4227d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec35e5a-6b44-4ea5-93ba-ae0b1e61dc79]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0acea1f-5355-4bd6-be44-39934f1d3fc7]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc46519-3f41-4a95-9b64-33802b04fdd0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6be2ba-5e74-4f0d-980a-3bd52ea06bfb]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[610220f1-fb81-4a23-a80b-2e1f78573e35]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a8f02-ac7e-4542-8e6d-06e1704d0200]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260]
Nov 19 15:27:12 user nova-compute[74934]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a, portal: 172.16.0.220,3260] successful.
Nov 19 15:27:12 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc4b9981-901f-4aa3-9801-98e31f26779a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[be29a143-d61e-47e5-add7-65b8308616ef]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== disconnect_volume: return (256ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:27:12 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:27:13 user nova-compute[74934]: DEBUG nova.objects.instance [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:27:13 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-70e223b6-5601-460c-955e-e3a55e4d1955 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.566s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:27:15 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:27:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:24 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:27:24 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.069801330566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:27:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:27:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:27:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:27:27 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:27:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:27:27 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:27:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:27:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:27:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:27:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:27:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:27:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:27:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:27:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:27:43 user nova-compute[74934]: DEBUG nova.objects.instance [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:27:43 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:27:44 user nova-compute[74934]: INFO nova.compute.manager [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attaching volume c99e5522-1cf7-4018-b4ba-34188387f93a to /dev/vdb
Nov 19 15:27:44 user nova-compute[74934]: DEBUG os_brick.utils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8607af-de1d-49cf-a17b-c16423fbe2e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1054f-d45a-40e6-a21f-eac215f588cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd4c6fe-5a2f-4487-9c42-e4d42c9e59ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[38019bc5-a93e-4d72-989f-32132404a4c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:27:44 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:27:44 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed24d90-990c-4d14-9324-ae880eff4ec1]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG os_brick.utils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:27:44 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating existing volume attachment record: c3e4e2c8-010d-495f-8fbb-6f1c06286a77 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:27:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:27:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:27:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:27:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:27:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrAuJtoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:27:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:27:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:27:49 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c82deb-aee3-47ec-bb0b-878679dd0871]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:27:49 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c695f-1007-4ddc-8f05-079104dde27e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a] added
Nov 19 15:27:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041b9ed-2796-4698-b427-026c2aa110ab]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfaa2c9-b126-48c9-a7d5-5b1628859baf]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrAuJtoH {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vrAuJtoH" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09db1d-c92f-4be8-a0cd-e6d8cc8799b1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vrAuJtoH'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe70299-a560-4a01-a057-bf14b0454e58]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d724b52f-2e92-4d56-9417-9a8f2bb1a445]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:27:49 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:27:49 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:27:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:27:49 user nova-compute[74934]: 
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ee86b-37d2-4fef-8f9c-2011f9ab6d10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260]
Nov 19 15:27:49 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260] successful.
Nov 19 15:27:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da2853-6d48-4fa7-b962-7efbc562a5da]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e8d1c7-719d-4611-996c-6c2d69d846d8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a (non-flash)
Nov 19 15:27:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a (non-flash)
Nov 19 15:27:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[25324ee2-af28-44b3-81c7-2fe54da56d6f]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:27:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrAuJtoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '26530373762326266', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530373762326266', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:27:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:27:50 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:27:50 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:27:50 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:27:50 user nova-compute[74934]:   <serial>c99e5522-1cf7-4018-b4ba-34188387f93a</serial>
Nov 19 15:27:50 user nova-compute[74934]: </disk>
Nov 19 15:27:50 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:27:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:27:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:27:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No VIF found with MAC fa:16:3e:01:b1:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:27:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-be28e747-f5f2-4973-86b2-84a3adba9ddd tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.238s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:27:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:27:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:27:53 user nova-compute[74934]: INFO nova.compute.manager [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Detaching volume c99e5522-1cf7-4018-b4ba-34188387f93a
Nov 19 15:27:53 user nova-compute[74934]: INFO nova.virt.block_device [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attempting to driver detach volume c99e5522-1cf7-4018-b4ba-34188387f93a from mountpoint /dev/vdb
Nov 19 15:27:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Attempting to detach device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:27:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:27:53 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:27:53 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:27:53 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:27:53 user nova-compute[74934]:   <serial>c99e5522-1cf7-4018-b4ba-34188387f93a</serial>
Nov 19 15:27:53 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:27:53 user nova-compute[74934]: </disk>
Nov 19 15:27:53 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:27:53 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config.
Nov 19 15:27:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:27:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:27:53 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:27:53 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:27:53 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:27:53 user nova-compute[74934]:   <serial>c99e5522-1cf7-4018-b4ba-34188387f93a</serial>
Nov 19 15:27:53 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:27:53 user nova-compute[74934]: </disk>
Nov 19 15:27:53 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:27:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:27:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:27:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:13 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f is timed out.
Nov 19 15:28:13 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config.
Nov 19 15:28:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vrAuJtoH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:28:13 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee6d009-3265-407f-a643-7c128120cf5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:28:13 user nova-compute[74934]: No targets found.
Nov 19 15:28:13 user nova-compute[74934]: iSNS:
Nov 19 15:28:13 user nova-compute[74934]: No targets found.
Nov 19 15:28:13 user nova-compute[74934]: STATIC:
Nov 19 15:28:13 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a
Nov 19 15:28:13 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:28:13 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:28:13 user nova-compute[74934]: FIRMWARE:
Nov 19 15:28:13 user nova-compute[74934]: No targets found.
Nov 19 15:28:13 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:28:13 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:28:13 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3deaed-e2a1-4690-953c-799b788c7d25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[04484015-f725-472d-9a81-833fbbf45098]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a (non-flash)
Nov 19 15:28:13 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a (non-flash)
Nov 19 15:28:13 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e4dc3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69f2d6-c767-4cf0-82aa-8ffa37b602c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ed5fa-f7e7-41cc-a9d4-c6d1dd8fa287]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9724b-1139-482d-bf9f-92069b9bd3b5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c856fd-8fc0-460e-aad0-527c412ef010]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f18705-6593-4d42-a9e6-937e938e0cc8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abe255b-9bd1-4bdb-b7fd-2060b5a34c4e]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260]
Nov 19 15:28:13 user nova-compute[74934]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a, portal: 172.16.0.220,3260] successful.
Nov 19 15:28:13 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99e5522-1cf7-4018-b4ba-34188387f93a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fbc933-a51e-454c-99b8-fb4ce5fd6a3b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== disconnect_volume: return (286ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:28:13 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:28:14 user nova-compute[74934]: DEBUG nova.objects.instance [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:28:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-a629aa10-7066-4ebd-9f42-91a2ca23e548 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.632s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:28:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:28:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:21 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:28:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:25 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:28:25 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9040MB free_disk=25.068817138671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:28:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:28:27 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:28:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:28:27 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:28:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:28:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:28:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:28:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:28:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:28:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG nova.objects.instance [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:28:46 user nova-compute[74934]: INFO nova.compute.manager [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attaching volume 62972d6d-dd1a-4ee8-87ae-35522222922d to /dev/vdb
Nov 19 15:28:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG os_brick.utils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[29172d8b-29ba-4a1e-af9e-1a5289d54ddc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bcbb34-eeaa-4834-a69d-4d5787c24aa0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c338c391-3240-45c5-92cb-ce16f6c5087b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[febdf42e-adf6-4734-92da-86ca4dae97d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:28:46 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:28:46 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[24641dae-53ba-4b90-a17d-a284c6be8746]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG os_brick.utils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:28:46 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating existing volume attachment record: 7d907a03-cfec-4dc8-ba06-be8536fa18f2 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:28:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGyPbxVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:28:51 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:28:51 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:28:51 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff082cc2-b5ef-476e-bf5c-530680d3f450]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:28:51 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e78d2-dc61-4a6e-b58b-b85c7c31f25e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d] added
Nov 19 15:28:51 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f79cb6c-4115-4522-9747-ba2370ffaacd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a38a1d-ad61-4684-9114-6e18acd2919f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:51 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGyPbxVr {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gGyPbxVr" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb27ea-a692-49bc-8654-6aac2e04201b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gGyPbxVr'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a574a-e485-47ec-9823-9d1f708b36bc]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e72618-0179-4395-8a32-22518f75704f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:28:52 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:28:52 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:28:52 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:28:52 user nova-compute[74934]: 
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2240859e-68ec-41af-baec-fe9499b9e5dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260]
Nov 19 15:28:52 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260] successful.
Nov 19 15:28:52 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b23b0-3be5-4f85-a673-71b1ce103778]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3954c85-9657-413b-9356-7eae940696d7]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d (non-flash)
Nov 19 15:28:52 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d (non-flash)
Nov 19 15:28:52 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b6c12a-d637-4be2-9d5f-3045ee9fdcd0]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:28:52 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGyPbxVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26138376237663732', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138376237663732', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:28:53 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:28:53 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:28:53 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:28:53 user nova-compute[74934]:   <serial>62972d6d-dd1a-4ee8-87ae-35522222922d</serial>
Nov 19 15:28:53 user nova-compute[74934]: </disk>
Nov 19 15:28:53 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No VIF found with MAC fa:16:3e:01:b1:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:28:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-897c74aa-cdfc-45ec-ae01-54f979bca393 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.392s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:28:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:28:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:28:55 user nova-compute[74934]: INFO nova.compute.manager [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Detaching volume 62972d6d-dd1a-4ee8-87ae-35522222922d
Nov 19 15:28:55 user nova-compute[74934]: INFO nova.virt.block_device [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attempting to driver detach volume 62972d6d-dd1a-4ee8-87ae-35522222922d from mountpoint /dev/vdb
Nov 19 15:28:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Attempting to detach device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:28:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:28:55 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:28:55 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:28:55 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:28:55 user nova-compute[74934]:   <serial>62972d6d-dd1a-4ee8-87ae-35522222922d</serial>
Nov 19 15:28:55 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:28:55 user nova-compute[74934]: </disk>
Nov 19 15:28:55 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:28:55 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config.
Nov 19 15:28:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:28:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:28:55 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:28:55 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:28:55 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:28:55 user nova-compute[74934]:   <serial>62972d6d-dd1a-4ee8-87ae-35522222922d</serial>
Nov 19 15:28:55 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:28:55 user nova-compute[74934]: </disk>
Nov 19 15:28:55 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:28:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:28:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:28:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:29:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:29:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:29:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:15 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f is timed out.
Nov 19 15:29:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config.
Nov 19 15:29:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gGyPbxVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:29:15 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:29:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16de243-cdea-41e2-b58a-6a304024a3a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:29:15 user nova-compute[74934]: No targets found.
Nov 19 15:29:15 user nova-compute[74934]: iSNS:
Nov 19 15:29:15 user nova-compute[74934]: No targets found.
Nov 19 15:29:15 user nova-compute[74934]: STATIC:
Nov 19 15:29:15 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d
Nov 19 15:29:15 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:29:15 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:29:15 user nova-compute[74934]: FIRMWARE:
Nov 19 15:29:15 user nova-compute[74934]: No targets found.
Nov 19 15:29:15 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:29:15 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:29:15 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:29:15 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb08cfd-e141-4173-bca7-deaee55783bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f69815-6687-4733-ba9b-bdfbc5a69d84]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d (non-flash)
Nov 19 15:29:16 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d (non-flash)
Nov 19 15:29:16 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c42a4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0de9e36-d88c-422c-a86b-8ec34eba9473]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a024e8e4-4afa-43b7-8301-251e1ec4d7da]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df0bf59-d5bd-40ed-9a51-35d62052def6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1509f695-601a-4427-bed1-b05993a9cc52]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2fbeed-359f-4a53-86e9-6f17706b51c7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd00722-c1e5-41b3-84e7-d14658f98442]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260]
Nov 19 15:29:16 user nova-compute[74934]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d, portal: 172.16.0.220,3260] successful.
Nov 19 15:29:16 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62972d6d-dd1a-4ee8-87ae-35522222922d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63e09c7-11e1-47b6-96b2-7c8ab2c8fbf5]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== disconnect_volume: return (295ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:29:16 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:29:17 user nova-compute[74934]: DEBUG nova.objects.instance [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:29:17 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-2d194215-9d86-43fd-9d67-5a08bbf5d2d7 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:29:17 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:22 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:29:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:29:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:29:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:29:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:27 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:29:27 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.067848205566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:29:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:29:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:29:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:32 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:29:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:29:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:29:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:39 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:39 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:29:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:42 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:29:42 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:29:42 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:29:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG nova.objects.instance [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:29:48 user nova-compute[74934]: INFO nova.compute.manager [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attaching volume e7b1c40c-137f-47a4-8542-a48e6767539a to /dev/vdb
Nov 19 15:29:48 user nova-compute[74934]: DEBUG os_brick.utils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[451a13f1-b500-4f1f-a389-607190421a5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[416baaaa-4c8c-41cc-9fa3-4aedeec86c41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910cec9-92ae-492e-bd67-d9c6f11e70f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6326421-712c-4ca8-b289-a2805f84f883]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:29:48 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:29:48 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef62d8-1627-4f69-a674-0f2107a2cbf0]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG os_brick.utils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:29:48 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating existing volume attachment record: a5152b0d-86b2-424b-8685-6302c4328ed9 {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:29:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:29:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJzhrTZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:29:54 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:29:54 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:29:54 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed7d3cb-51c7-42d0-959e-11bc186e3b45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:29:54 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68a6fa-b3b7-4e4a-bc16-941e6d938437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a] added
Nov 19 15:29:54 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda7566f-8509-4f5d-8d34-97f87d612857]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2fe097-4212-4398-917f-9435501d618a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJzhrTZA {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJzhrTZA" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb716f-f6f8-4a29-a6c1-074c88fa586f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kJzhrTZA'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[df974d97-4d87-4313-9b3d-678fa4df3579]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7460689-ec41-416a-b50f-195f0183b2e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:29:54 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:29:54 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:29:54 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:29:54 user nova-compute[74934]: 
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f955e60-258e-48a1-92ac-0845daaaa869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260]
Nov 19 15:29:54 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260] successful.
Nov 19 15:29:54 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8748a05d-d46d-4eef-bece-df7b475f8a8b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba39220-2e8d-4911-913f-00ad2fdfe071]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a (non-flash)
Nov 19 15:29:54 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a (non-flash)
Nov 19 15:29:54 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe6660-e338-4490-8e36-2608fc1730da]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:29:54 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJzhrTZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26465636431303564', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465636431303564', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:29:55 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:29:55 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:29:55 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:29:55 user nova-compute[74934]:   <serial>e7b1c40c-137f-47a4-8542-a48e6767539a</serial>
Nov 19 15:29:55 user nova-compute[74934]: </disk>
Nov 19 15:29:55 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] No VIF found with MAC fa:16:3e:01:b1:7a, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:29:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fcef2d44-d2b3-484f-b45e-18b9fe757eb4 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.264s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:29:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:29:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:29:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:29:57 user nova-compute[74934]: INFO nova.compute.manager [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Detaching volume e7b1c40c-137f-47a4-8542-a48e6767539a
Nov 19 15:29:57 user nova-compute[74934]: INFO nova.virt.block_device [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Attempting to driver detach volume e7b1c40c-137f-47a4-8542-a48e6767539a from mountpoint /dev/vdb
Nov 19 15:29:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Attempting to detach device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:29:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:29:57 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:29:57 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:29:57 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:29:57 user nova-compute[74934]:   <serial>e7b1c40c-137f-47a4-8542-a48e6767539a</serial>
Nov 19 15:29:57 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:29:57 user nova-compute[74934]: </disk>
Nov 19 15:29:57 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:29:57 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the persistent domain config.
Nov 19 15:29:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:29:57 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:29:57 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:29:57 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:29:57 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:29:57 user nova-compute[74934]:   <serial>e7b1c40c-137f-47a4-8542-a48e6767539a</serial>
Nov 19 15:29:57 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:29:57 user nova-compute[74934]: </disk>
Nov 19 15:29:57 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:29:58 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:30:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:30:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:30:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:18 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f is timed out.
Nov 19 15:30:18 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully detached device vdb from instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f from the live domain config.
Nov 19 15:30:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJzhrTZA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:30:18 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[124d287c-0323-46ed-be72-9364d3909d5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:30:18 user nova-compute[74934]: No targets found.
Nov 19 15:30:18 user nova-compute[74934]: iSNS:
Nov 19 15:30:18 user nova-compute[74934]: No targets found.
Nov 19 15:30:18 user nova-compute[74934]: STATIC:
Nov 19 15:30:18 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a
Nov 19 15:30:18 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:30:18 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:30:18 user nova-compute[74934]: FIRMWARE:
Nov 19 15:30:18 user nova-compute[74934]: No targets found.
Nov 19 15:30:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:30:18 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:30:18 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ec313-144f-40f7-9cd8-3d8ef6655a55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee59a12-d0de-4a1c-98ba-857516056fef]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a (non-flash)
Nov 19 15:30:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a (non-flash)
Nov 19 15:30:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13dc2901f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc37a2d-197c-45b2-9fd5-c503c55bd62b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[81319789-7277-4fc2-b654-fbc19caef24b]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c3430-8492-4d5a-8ba9-fc8e3639a82d]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f43780-4a98-4b49-97a4-6496d54e3be3]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[756ce9aa-1e8e-413b-bf74-c76a1b4b1a5b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea385a07-114e-43d3-8746-7b2246044af2]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260]
Nov 19 15:30:18 user nova-compute[74934]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a, portal: 172.16.0.220,3260] successful.
Nov 19 15:30:18 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7b1c40c-137f-47a4-8542-a48e6767539a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261c749-8b62-403f-912d-5e337b49c46a]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] <== disconnect_volume: return (290ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:30:18 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:30:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:19 user nova-compute[74934]: DEBUG nova.objects.instance [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'flavor' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:30:19 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-10ac811f-d9fb-4054-8092-acd1edb83834 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:30:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:30:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:30:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:30:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:30:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:30:27 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:30:27 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9033MB free_disk=25.066913604736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:30:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:30:29 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [{"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-7fe2aebd-c51f-4bb9-801c-746dc3ac003f" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:35 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:30:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:30:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:30:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:30:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:30:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:30:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:30:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:30:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:06 user nova-compute[74934]: INFO nova.compute.manager [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Terminating instance
Nov 19 15:31:06 user nova-compute[74934]: DEBUG nova.compute.manager [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2d13af93-0811-4983-abbf-73609556333a req-6dd18671-3ecb-4110-adde-dd7eb8f0ace3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-unplugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2d13af93-0811-4983-abbf-73609556333a req-6dd18671-3ecb-4110-adde-dd7eb8f0ace3 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2d13af93-0811-4983-abbf-73609556333a req-6dd18671-3ecb-4110-adde-dd7eb8f0ace3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-2d13af93-0811-4983-abbf-73609556333a req-6dd18671-3ecb-4110-adde-dd7eb8f0ace3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2d13af93-0811-4983-abbf-73609556333a req-6dd18671-3ecb-4110-adde-dd7eb8f0ace3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-unplugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG nova.compute.manager [req-2d13af93-0811-4983-abbf-73609556333a req-6dd18671-3ecb-4110-adde-dd7eb8f0ace3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-unplugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:31:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Instance destroyed successfully.
Nov 19 15:31:07 user nova-compute[74934]: DEBUG nova.objects.instance [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lazy-loading 'resources' on Instance uuid 7fe2aebd-c51f-4bb9-801c-746dc3ac003f {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-139685677',display_name='tempest-SnapshotDataIntegrityTests-server-139685677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-139685677',id=52,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtfP6RlaYOMiHCHbv7o3JrHSeER7mZiZPfq2jk/oGTh/DlIow/80e7H3l+Y9bT83hfiNrqMqZMas6U/8ScgIRGKDet3pT52zLfFQyii3/wMbcz6KXpAV2Ks4s2ZAMxR6Q==',key_name='tempest-keypair-272501707',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ed82dfd14f44783bc2461b7eebcfc76',ramdisk_id='',reservation_id='r-rkyzyuth',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-406787885',owner_user_name='tempest-SnapshotDataIntegrityTests-406787885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b11cc77648694d1b91e5d6818ae2219d',uuid=7fe2aebd-c51f-4bb9-801c-746dc3ac003f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Converting VIF {"id": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "address": "fa:16:3e:01:b1:7a", "network": {"id": "38bb397b-8b4f-46d8-9ed2-ce11e31d29c3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1914622566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ed82dfd14f44783bc2461b7eebcfc76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f60e58c-1a", "ovs_interfaceid": "2f60e58c-1ab5-4b4a-8875-86bd99498044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG os_vif [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f60e58c-1a, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=915881c9-17a5-474f-b010-af96e2078da7) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:07 user nova-compute[74934]: INFO os_vif [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:b1:7a,bridge_name='br-int',has_traffic_filtering=True,id=2f60e58c-1ab5-4b4a-8875-86bd99498044,network=Network(38bb397b-8b4f-46d8-9ed2-ce11e31d29c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f60e58c-1a')
Nov 19 15:31:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Deleting instance files /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f_del
Nov 19 15:31:07 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Deletion of /opt/stack/data/nova/instances/7fe2aebd-c51f-4bb9-801c-746dc3ac003f_del complete
Nov 19 15:31:07 user nova-compute[74934]: INFO nova.compute.manager [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 19 15:31:07 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:31:08 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Took 0.79 seconds to deallocate network for instance.
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-dfb1ab48-b099-46a3-9106-76fb89e08238 req-32d2ffc7-0bb3-4854-8ae6-fbe743b649e8 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-deleted-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Deleted allocations for instance 7fe2aebd-c51f-4bb9-801c-746dc3ac003f
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-ad0dfd2d-8614-4316-ac0d-3dfc2874ee93 tempest-SnapshotDataIntegrityTests-406787885 tempest-SnapshotDataIntegrityTests-406787885-project-member] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.127s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:31:08 user nova-compute[74934]: WARNING nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state deleted and task_state None.
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:31:08 user nova-compute[74934]: WARNING nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state deleted and task_state None.
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:31:08 user nova-compute[74934]: WARNING nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state deleted and task_state None.
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-unplugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-unplugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:31:08 user nova-compute[74934]: WARNING nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-unplugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state deleted and task_state None.
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Acquiring lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] Lock "7fe2aebd-c51f-4bb9-801c-746dc3ac003f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:08 user nova-compute[74934]: DEBUG nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] No waiting events found dispatching network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:31:08 user nova-compute[74934]: WARNING nova.compute.manager [req-b90bcdae-7927-49b7-b0f5-18b16274f8fd req-7d1bf1e8-5c51-41c9-aeba-e1dcea9ed4b3 service nova] [instance: 7fe2aebd-c51f-4bb9-801c-746dc3ac003f] Received unexpected event network-vif-plugged-2f60e58c-1ab5-4b4a-8875-86bd99498044 for instance with vm_state deleted and task_state None.
Nov 19 15:31:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:19 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:31:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:31:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:31:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:31:26 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=25.093894958496094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:31:26 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:31:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:31:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:31:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:31:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:31:29 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:31:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:36 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:31:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:31:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:31:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:31:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:31:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:31:57 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:02 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:03 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:12 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:32:17 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:20 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:21 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:22 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:32:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:32:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:32:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:32:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:32:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.083114624023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:32:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:32:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:32:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:32:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:32 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:33 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:36 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:37 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:37 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:38 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:32:38 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:42 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Starting instance... {{(pid=74934) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74934) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 19 15:32:47 user nova-compute[74934]: INFO nova.compute.claims [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Claim successful on node user
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Start building networks asynchronously for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Allocating IP information in the background. {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 19 15:32:47 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] allocate_for_instance() {{(pid=74934) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 19 15:32:47 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 19 15:32:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Start building block device mappings for instance. {{(pid=74934) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG nova.policy [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0f5e22095db40369b70a37bbb1e4953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8072f2b042e34ad39991a920301b017b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74934) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Start spawning the instance on the hypervisor. {{(pid=74934) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Creating instance directory {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 19 15:32:48 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Creating image(s)
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "/opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "/opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "/opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.275s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "e41a84bbc80c0413578ee96f4842da9c245b94df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.206s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk 1073741824 {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df,backing_fmt=raw /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk 1073741824" returned: 0 in 0.063s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "e41a84bbc80c0413578ee96f4842da9c245b94df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e41a84bbc80c0413578ee96f4842da9c245b94df --force-share --output=json" returned: 0 in 0.216s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk. size=1073741824 {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 19 15:32:48 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Successfully created port: 64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.virt.disk.api [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Cannot resize image /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk to a smaller size. {{(pid=74934) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Created local disks {{(pid=74934) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Ensure instance console log exists: /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/console.log {{(pid=74934) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Successfully updated port: 64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Building network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-changed-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.compute.manager [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Refreshing instance network info cache due to event network-changed-64de4ca8-de34-47d7-808c-1579508203b4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:32:49 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Instance cache missing network info. {{(pid=74934) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.neutron [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Instance network_info: |[{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74934) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Refreshing network info cache for port 64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Start _get_guest_xml network_info=[{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'image_id': '010d533e-05ed-478e-9adb-00e830e2c77e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 19 15:32:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:32:50 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CPU controller missing on host. {{(pid=74934) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.host [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CPU controller found on host. {{(pid=74934) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74934) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-19T14:44:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-19T14:44:14Z,direct_url=<?>,disk_format='qcow2',id=010d533e-05ed-478e-9adb-00e830e2c77e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cab4cffaa7df4895a59e3dbe3422c928',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-19T14:44:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Flavor limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Image limits 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Flavor pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Image pref 0:0:0 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Got 1 possible topologies {{(pid=74934) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.hardware [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74934) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:32:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1212808635',display_name='tempest-SnapshotDataIntegrityTests-server-1212808635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1212808635',id=53,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMlbSCTEBelDkDy2EpjwdbScnrlqWGsMrt1f8rhNin1zODuz1F06vLn84W/QuX39mMZd+1Lr93FOH7ywv1kbmrUzuKyVSYxJgwUTIWnZ6AWMZc1BIS8OEi+sEWneMpIOA==',key_name='tempest-keypair-122573664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8072f2b042e34ad39991a920301b017b',ramdisk_id='',reservation_id='r-nklu38gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-378454966',owner_user_name='tempest-SnapshotDataIntegrityTests-378454966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0f5e22095db40369b70a37bbb1e4953',uuid=80076a8f-e917-4738-af07-63381e0601da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74934) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Converting VIF {"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'pci_devices' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] End _get_guest_xml xml=<domain type="kvm">
Nov 19 15:32:50 user nova-compute[74934]:   <uuid>80076a8f-e917-4738-af07-63381e0601da</uuid>
Nov 19 15:32:50 user nova-compute[74934]:   <name>instance-00000035</name>
Nov 19 15:32:50 user nova-compute[74934]:   <memory>524288</memory>
Nov 19 15:32:50 user nova-compute[74934]:   <vcpu>1</vcpu>
Nov 19 15:32:50 user nova-compute[74934]:   <metadata>
Nov 19 15:32:50 user nova-compute[74934]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 19 15:32:50 user nova-compute[74934]:       <nova:package version="0.0.0"/>
Nov 19 15:32:50 user nova-compute[74934]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1212808635</nova:name>
Nov 19 15:32:50 user nova-compute[74934]:       <nova:creationTime>2023-11-19 15:32:50</nova:creationTime>
Nov 19 15:32:50 user nova-compute[74934]:       <nova:flavor name="m1.tiny">
Nov 19 15:32:50 user nova-compute[74934]:         <nova:memory>512</nova:memory>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:disk>1</nova:disk>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:swap>0</nova:swap>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:ephemeral>0</nova:ephemeral>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:vcpus>1</nova:vcpus>
Nov 19 15:32:50 user nova-compute[74934]:       </nova:flavor>
Nov 19 15:32:50 user nova-compute[74934]:       <nova:owner>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:user uuid="e0f5e22095db40369b70a37bbb1e4953">tempest-SnapshotDataIntegrityTests-378454966-project-member</nova:user>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:project uuid="8072f2b042e34ad39991a920301b017b">tempest-SnapshotDataIntegrityTests-378454966</nova:project>
Nov 19 15:32:50 user nova-compute[74934]:       </nova:owner>
Nov 19 15:32:50 user nova-compute[74934]:       <nova:root type="image" uuid="010d533e-05ed-478e-9adb-00e830e2c77e"/>
Nov 19 15:32:50 user nova-compute[74934]:       <nova:ports>
Nov 19 15:32:50 user nova-compute[74934]:         <nova:port uuid="64de4ca8-de34-47d7-808c-1579508203b4">
Nov 19 15:32:50 user nova-compute[74934]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 19 15:32:50 user nova-compute[74934]:         </nova:port>
Nov 19 15:32:50 user nova-compute[74934]:       </nova:ports>
Nov 19 15:32:50 user nova-compute[74934]:     </nova:instance>
Nov 19 15:32:50 user nova-compute[74934]:   </metadata>
Nov 19 15:32:50 user nova-compute[74934]:   <sysinfo type="smbios">
Nov 19 15:32:50 user nova-compute[74934]:     <system>
Nov 19 15:32:50 user nova-compute[74934]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 19 15:32:50 user nova-compute[74934]:       <entry name="product">OpenStack Nova</entry>
Nov 19 15:32:50 user nova-compute[74934]:       <entry name="version">0.0.0</entry>
Nov 19 15:32:50 user nova-compute[74934]:       <entry name="serial">80076a8f-e917-4738-af07-63381e0601da</entry>
Nov 19 15:32:50 user nova-compute[74934]:       <entry name="uuid">80076a8f-e917-4738-af07-63381e0601da</entry>
Nov 19 15:32:50 user nova-compute[74934]:       <entry name="family">Virtual Machine</entry>
Nov 19 15:32:50 user nova-compute[74934]:     </system>
Nov 19 15:32:50 user nova-compute[74934]:   </sysinfo>
Nov 19 15:32:50 user nova-compute[74934]:   <os>
Nov 19 15:32:50 user nova-compute[74934]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 19 15:32:50 user nova-compute[74934]:     <boot dev="hd"/>
Nov 19 15:32:50 user nova-compute[74934]:     <smbios mode="sysinfo"/>
Nov 19 15:32:50 user nova-compute[74934]:   </os>
Nov 19 15:32:50 user nova-compute[74934]:   <features>
Nov 19 15:32:50 user nova-compute[74934]:     <acpi/>
Nov 19 15:32:50 user nova-compute[74934]:     <apic/>
Nov 19 15:32:50 user nova-compute[74934]:     <vmcoreinfo/>
Nov 19 15:32:50 user nova-compute[74934]:   </features>
Nov 19 15:32:50 user nova-compute[74934]:   <clock offset="utc">
Nov 19 15:32:50 user nova-compute[74934]:     <timer name="pit" tickpolicy="delay"/>
Nov 19 15:32:50 user nova-compute[74934]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 19 15:32:50 user nova-compute[74934]:     <timer name="hpet" present="no"/>
Nov 19 15:32:50 user nova-compute[74934]:   </clock>
Nov 19 15:32:50 user nova-compute[74934]:   <cpu mode="custom" match="exact">
Nov 19 15:32:50 user nova-compute[74934]:     <model>Nehalem</model>
Nov 19 15:32:50 user nova-compute[74934]:     <topology sockets="1" cores="1" threads="1"/>
Nov 19 15:32:50 user nova-compute[74934]:   </cpu>
Nov 19 15:32:50 user nova-compute[74934]:   <devices>
Nov 19 15:32:50 user nova-compute[74934]:     <disk type="file" device="disk">
Nov 19 15:32:50 user nova-compute[74934]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 19 15:32:50 user nova-compute[74934]:       <source file="/opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk"/>
Nov 19 15:32:50 user nova-compute[74934]:       <target dev="vda" bus="virtio"/>
Nov 19 15:32:50 user nova-compute[74934]:     </disk>
Nov 19 15:32:50 user nova-compute[74934]:     <interface type="ethernet">
Nov 19 15:32:50 user nova-compute[74934]:       <mac address="fa:16:3e:9d:a4:26"/>
Nov 19 15:32:50 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:32:50 user nova-compute[74934]:       <mtu size="1442"/>
Nov 19 15:32:50 user nova-compute[74934]:       <target dev="tap64de4ca8-de"/>
Nov 19 15:32:50 user nova-compute[74934]:     </interface>
Nov 19 15:32:50 user nova-compute[74934]:     <serial type="pty">
Nov 19 15:32:50 user nova-compute[74934]:       <log file="/opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/console.log" append="off"/>
Nov 19 15:32:50 user nova-compute[74934]:     </serial>
Nov 19 15:32:50 user nova-compute[74934]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 19 15:32:50 user nova-compute[74934]:     <video>
Nov 19 15:32:50 user nova-compute[74934]:       <model type="virtio"/>
Nov 19 15:32:50 user nova-compute[74934]:     </video>
Nov 19 15:32:50 user nova-compute[74934]:     <rng model="virtio">
Nov 19 15:32:50 user nova-compute[74934]:       <backend model="random">/dev/urandom</backend>
Nov 19 15:32:50 user nova-compute[74934]:     </rng>
Nov 19 15:32:50 user nova-compute[74934]:     <controller type="usb" index="0" model="none"/>
Nov 19 15:32:50 user nova-compute[74934]:     <memballoon model="virtio">
Nov 19 15:32:50 user nova-compute[74934]:       <stats period="10"/>
Nov 19 15:32:50 user nova-compute[74934]:     </memballoon>
Nov 19 15:32:50 user nova-compute[74934]:   </devices>
Nov 19 15:32:50 user nova-compute[74934]: </domain>
Nov 19 15:32:50 user nova-compute[74934]:  {{(pid=74934) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:32:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1212808635',display_name='tempest-SnapshotDataIntegrityTests-server-1212808635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1212808635',id=53,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMlbSCTEBelDkDy2EpjwdbScnrlqWGsMrt1f8rhNin1zODuz1F06vLn84W/QuX39mMZd+1Lr93FOH7ywv1kbmrUzuKyVSYxJgwUTIWnZ6AWMZc1BIS8OEi+sEWneMpIOA==',key_name='tempest-keypair-122573664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8072f2b042e34ad39991a920301b017b',ramdisk_id='',reservation_id='r-nklu38gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-378454966',owner_user_name='tempest-SnapshotDataIntegrityTests-378454966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-19T15:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0f5e22095db40369b70a37bbb1e4953',uuid=80076a8f-e917-4738-af07-63381e0601da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Converting VIF {"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG os_vif [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de') {{(pid=74934) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a289f37-0bab-5075-8c8b-f1dcc5e3c5b7', '_type': 'linux-noop'}}, row=False) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64de4ca8-de, may_exist=True, interface_attrs={}) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64de4ca8-de, col_values=(('qos', UUID('5362f7bd-5b39-45cb-ab76-5f56df8ad281')),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64de4ca8-de, col_values=(('external_ids', {'iface-id': '64de4ca8-de34-47d7-808c-1579508203b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:a4:26', 'vm-uuid': '80076a8f-e917-4738-af07-63381e0601da'}),), if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:50 user nova-compute[74934]: INFO os_vif [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de')
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No VIF found with MAC fa:16:3e:9d:a4:26, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated VIF entry in instance network info cache for port 64de4ca8-de34-47d7-808c-1579508203b4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG nova.network.neutron [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:32:50 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-9164455b-524e-4163-b7d0-f81d5a7019bf req-cc3b5a6f-2cf0-49ff-884c-1802c464731c service nova] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c4b04a70-f900-486c-a3a0-aa375e681544 req-50c159d2-63ea-42b9-b729-1665f2eba41b service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c4b04a70-f900-486c-a3a0-aa375e681544 req-50c159d2-63ea-42b9-b729-1665f2eba41b service nova] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c4b04a70-f900-486c-a3a0-aa375e681544 req-50c159d2-63ea-42b9-b729-1665f2eba41b service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-c4b04a70-f900-486c-a3a0-aa375e681544 req-50c159d2-63ea-42b9-b729-1665f2eba41b service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:51 user nova-compute[74934]: DEBUG nova.compute.manager [req-c4b04a70-f900-486c-a3a0-aa375e681544 req-50c159d2-63ea-42b9-b729-1665f2eba41b service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] No waiting events found dispatching network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:32:51 user nova-compute[74934]: WARNING nova.compute.manager [req-c4b04a70-f900-486c-a3a0-aa375e681544 req-50c159d2-63ea-42b9-b729-1665f2eba41b service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received unexpected event network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 for instance with vm_state building and task_state spawning.
Nov 19 15:32:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:52 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-3e5d91b3-d83a-42b1-adc0-1ff1f95f1dac req-e6467d6a-c190-4d1a-b3e6-98bb516838e6 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3e5d91b3-d83a-42b1-adc0-1ff1f95f1dac req-e6467d6a-c190-4d1a-b3e6-98bb516838e6 service nova] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3e5d91b3-d83a-42b1-adc0-1ff1f95f1dac req-e6467d6a-c190-4d1a-b3e6-98bb516838e6 service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3e5d91b3-d83a-42b1-adc0-1ff1f95f1dac req-e6467d6a-c190-4d1a-b3e6-98bb516838e6 service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.compute.manager [req-3e5d91b3-d83a-42b1-adc0-1ff1f95f1dac req-e6467d6a-c190-4d1a-b3e6-98bb516838e6 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] No waiting events found dispatching network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:32:54 user nova-compute[74934]: WARNING nova.compute.manager [req-3e5d91b3-d83a-42b1-adc0-1ff1f95f1dac req-e6467d6a-c190-4d1a-b3e6-98bb516838e6 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received unexpected event network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 for instance with vm_state building and task_state spawning.
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Instance event wait completed in 0 seconds for  {{(pid=74934) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Guest created on hypervisor {{(pid=74934) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 19 15:32:54 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 80076a8f-e917-4738-af07-63381e0601da] Instance spawned successfully.
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Found default for hw_cdrom_bus of ide {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Found default for hw_disk_bus of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Found default for hw_input_bus of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Found default for hw_pointer_model of None {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Found default for hw_video_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Found default for hw_vif_model of virtio {{(pid=74934) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 19 15:32:54 user nova-compute[74934]: INFO nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 19 15:32:54 user nova-compute[74934]: DEBUG nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Checking state {{(pid=74934) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 19 15:32:54 user nova-compute[74934]: INFO nova.compute.manager [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Took 6.87 seconds to build instance.
Nov 19 15:32:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-13c8638e-df2b-49e2-aafd-b4bbbf5f7b72 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.082s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:32:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:32:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:16 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:21 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:22 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:23 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:23 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:33:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:26 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:33:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:33:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:33:28 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=25.040451049804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 80076a8f-e917-4738-af07-63381e0601da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:33:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:33:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:33:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:33:39 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:33:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:33:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:33:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:33:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:33:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:33:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:33:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:33:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:34:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:34:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:34:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:25 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:34:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:28 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:29 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:34:29 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.039791107177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 80076a8f-e917-4738-af07-63381e0601da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:34:29 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:34:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:34:32 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:34:33 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:34:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:34:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:34:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:34:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:34:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:34:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-changed-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG nova.compute.manager [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Refreshing instance network info cache due to event network-changed-64de4ca8-de34-47d7-808c-1579508203b4. {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Refreshing network info cache for port 64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated VIF entry in instance network info cache for port 64de4ca8-de34-47d7-808c-1579508203b4. {{(pid=74934) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG nova.network.neutron [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:34:38 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-1f174193-da74-4e9b-9346-13cd8b76a66c req-29599282-8e0c-43b9-a9d0-43528400f6a4 service nova] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:34:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:40 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:41 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:34:41 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:34:41 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:34:42 user nova-compute[74934]: INFO nova.compute.manager [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attaching volume 83631e12-b7c1-4e96-b5dd-353b159d3a75 to /dev/vdb
Nov 19 15:34:42 user nova-compute[74934]: DEBUG os_brick.utils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c10c19-4b79-47ad-b395-a4e906c779bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[60922be9-224b-4427-9398-e517b0786b4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03dc717-05a8-4411-a78a-2bf393e6e221]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b32879a-0424-4ae3-8f92-a77e736e8643]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:34:42 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:34:42 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[96825e44-cb80-4710-b801-cf4522ce9fd1]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG os_brick.utils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:34:42 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating existing volume attachment record: c9444760-ba3e-4b7c-8054-573b0fe07bbf {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:34:43 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:45 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:34:45 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:34:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:46 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:34:46 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AckeXYQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:34:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:34:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:34:49 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e84cc-a50e-48b8-ab74-6ddd1e3466e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:34:49 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ab263-ec83-45e2-8004-60abd8c40b9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75] added
Nov 19 15:34:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1deda-3c29-4148-a704-0dca0e271f68]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25c7652-5b0b-4e6d-8828-22a07edf58dc]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AckeXYQT {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AckeXYQT" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc8c7db-4d68-4685-92fc-ab558a290b25]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AckeXYQT'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284d03e-6af7-48dd-bf92-8042183a11b6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b35bb0-247e-4965-9b2d-5d3aefb28343]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:34:49 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:34:49 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:34:49 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:34:49 user nova-compute[74934]: 
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[484d611e-7e7d-4a9e-9f74-d5efdc8e7f90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260]
Nov 19 15:34:49 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260] successful.
Nov 19 15:34:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e610b6-5346-4bd7-bfaa-2bc14ed5769e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5014c-2cf5-4ffd-ae8d-725794449cc5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 (non-flash)
Nov 19 15:34:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 (non-flash)
Nov 19 15:34:49 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc21983-4fa0-425d-9aef-cfc2a243513c]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:34:49 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AckeXYQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26239633432313666', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239633432313666', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG nova.objects.instance [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:34:50 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:34:50 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:34:50 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:34:50 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:34:50 user nova-compute[74934]:   <serial>83631e12-b7c1-4e96-b5dd-353b159d3a75</serial>
Nov 19 15:34:50 user nova-compute[74934]: </disk>
Nov 19 15:34:50 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:34:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:34:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:34:51 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No VIF found with MAC fa:16:3e:9d:a4:26, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:34:51 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-4f3ff3b6-d726-4ad9-83c1-b163e29f5ac7 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.207s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:34:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:34:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:35:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:35:01 user nova-compute[74934]: INFO nova.compute.manager [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Detaching volume 83631e12-b7c1-4e96-b5dd-353b159d3a75
Nov 19 15:35:01 user nova-compute[74934]: INFO nova.virt.block_device [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attempting to driver detach volume 83631e12-b7c1-4e96-b5dd-353b159d3a75 from mountpoint /dev/vdb
Nov 19 15:35:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Attempting to detach device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:35:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:35:01 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:35:01 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:35:01 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:35:01 user nova-compute[74934]:   <serial>83631e12-b7c1-4e96-b5dd-353b159d3a75</serial>
Nov 19 15:35:01 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:35:01 user nova-compute[74934]: </disk>
Nov 19 15:35:01 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:35:01 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config.
Nov 19 15:35:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:35:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:35:01 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:35:01 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:35:01 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:35:01 user nova-compute[74934]:   <serial>83631e12-b7c1-4e96-b5dd-353b159d3a75</serial>
Nov 19 15:35:01 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:35:01 user nova-compute[74934]: </disk>
Nov 19 15:35:01 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:35:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:35:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:07 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_power_states {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:07 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Triggering sync for uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 19 15:35:07 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:35:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:35:11 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:35:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:35:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:35:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:35:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:22 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da is timed out.
Nov 19 15:35:22 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config.
Nov 19 15:35:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AckeXYQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:35:22 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e90bb-960c-455f-aaec-11d2133d8126]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:35:22 user nova-compute[74934]: No targets found.
Nov 19 15:35:22 user nova-compute[74934]: iSNS:
Nov 19 15:35:22 user nova-compute[74934]: No targets found.
Nov 19 15:35:22 user nova-compute[74934]: STATIC:
Nov 19 15:35:22 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75
Nov 19 15:35:22 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:35:22 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:35:22 user nova-compute[74934]: FIRMWARE:
Nov 19 15:35:22 user nova-compute[74934]: No targets found.
Nov 19 15:35:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:35:22 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:35:22 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb540e-f92c-43b4-af1a-a3f89bffafb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d56fd3-6cb5-4532-8eac-c714538dbd2f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 (non-flash)
Nov 19 15:35:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 (non-flash)
Nov 19 15:35:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4444700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa805d8-a23a-44df-b6cd-644f5a0edacd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c41f1-07ec-4f4d-a5d5-6f78ee2afe92]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d3cbe-0154-4494-8652-6001f06c5ed8]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f0b13-2e17-4c4f-8a79-7748e33fd1fe]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[94691a1e-226c-4c01-962b-8aba8cb08e36]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[347094a6-10de-40b5-9cf0-b3d4b83b5d62]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260]
Nov 19 15:35:22 user nova-compute[74934]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75, portal: 172.16.0.220,3260] successful.
Nov 19 15:35:22 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83631e12-b7c1-4e96-b5dd-353b159d3a75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd47087-01fd-4f9d-b57c-48aba7a8ee63]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== disconnect_volume: return (272ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:35:22 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:35:23 user nova-compute[74934]: DEBUG nova.objects.instance [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:35:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-fc7ae267-51a3-41e7-9f70-130e2a665d99 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.661s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:35:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.281s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:35:23 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:35:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:26 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:27 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:35:29 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:30 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:35:31 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.038467407226562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 80076a8f-e917-4738-af07-63381e0601da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing inventories for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating ProviderTree inventory for provider a6d80b64-40fb-4268-950b-1de97ecbab67 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Updating inventory in ProviderTree for provider a6d80b64-40fb-4268-950b-1de97ecbab67 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing aggregate associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, aggregates: None {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Refreshing trait associations for resource provider a6d80b64-40fb-4268-950b-1de97ecbab67, traits: COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74934) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:35:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:35:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:35:34 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:35:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:35:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:35:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:35:37 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:42 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:35:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:35:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:35:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:35:53 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:35:53 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:35:54 user nova-compute[74934]: INFO nova.compute.manager [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attaching volume 3742c256-aaee-48d1-88a8-a7a5a0bc25f4 to /dev/vdb
Nov 19 15:35:54 user nova-compute[74934]: DEBUG os_brick.utils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4e1c6b-ce26-4fe0-9425-8f482241a683]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[265b013b-daf0-430d-9944-ea6b5e39d8b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f10aa4-78dc-4afd-bb3e-bb8424caa325]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f670e0-6074-4f80-877f-7e74ff63c8b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:35:54 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:35:54 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70284a1-c557-4e03-a9de-572c6d089d4b]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG os_brick.utils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:35:54 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating existing volume attachment record: 9fdec0d7-d266-4de2-af8e-9907541f295c {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:35:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxYNIVlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:35:59 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:35:59 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:35:59 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd239f-04b8-444c-a3a6-04f87bcbaa87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:35:59 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2830463c-f44e-4438-8a47-3210ebb8cbe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4] added
Nov 19 15:35:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c24c34a-2aa9-47b1-8d75-a3f1a6920158]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[25565d71-3681-447d-ab0c-7432657de785]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxYNIVlH {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KxYNIVlH" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc4255e-eafd-40d0-8cb6-051adf1627d6]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KxYNIVlH'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aecef2-5ec2-4850-a78a-94df48a0a186]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[327a900c-42f9-4edd-b362-5d167e597115]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:35:59 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:35:59 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:35:59 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:35:59 user nova-compute[74934]: 
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f88fe4-da48-4ee9-9706-4603561dacec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260]
Nov 19 15:35:59 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260] successful.
Nov 19 15:35:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b03b1a8-d9f2-4e63-8efd-02a4061b77fd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea0d1be-09b3-4f78-b314-4846a0a601c0]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 (non-flash)
Nov 19 15:35:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 (non-flash)
Nov 19 15:35:59 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc62d8f-6b70-4f56-af09-5d0202f747ff]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:35:59 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxYNIVlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23538363663323437', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538363663323437', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG nova.objects.instance [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:36:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:36:00 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:36:00 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:36:00 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:36:00 user nova-compute[74934]:   <serial>3742c256-aaee-48d1-88a8-a7a5a0bc25f4</serial>
Nov 19 15:36:00 user nova-compute[74934]: </disk>
Nov 19 15:36:00 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:36:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:36:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:36:01 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No VIF found with MAC fa:16:3e:9d:a4:26, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:36:01 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-e9449f2e-b066-42d3-9c24-65074e764396 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.085s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:36:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:36:03 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:36:03 user nova-compute[74934]: INFO nova.compute.manager [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Detaching volume 3742c256-aaee-48d1-88a8-a7a5a0bc25f4
Nov 19 15:36:03 user nova-compute[74934]: INFO nova.virt.block_device [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attempting to driver detach volume 3742c256-aaee-48d1-88a8-a7a5a0bc25f4 from mountpoint /dev/vdb
Nov 19 15:36:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Attempting to detach device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:36:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:36:03 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:36:03 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:36:03 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:36:03 user nova-compute[74934]:   <serial>3742c256-aaee-48d1-88a8-a7a5a0bc25f4</serial>
Nov 19 15:36:03 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:36:03 user nova-compute[74934]: </disk>
Nov 19 15:36:03 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:36:03 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config.
Nov 19 15:36:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:36:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:36:03 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:36:03 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:36:03 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:36:03 user nova-compute[74934]:   <serial>3742c256-aaee-48d1-88a8-a7a5a0bc25f4</serial>
Nov 19 15:36:03 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:36:03 user nova-compute[74934]: </disk>
Nov 19 15:36:03 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:36:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:36:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:36:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:36:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:36:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:23 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da is timed out.
Nov 19 15:36:23 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config.
Nov 19 15:36:23 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KxYNIVlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:36:23 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c2f33b-a2e7-4241-b55b-495e23bf486c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:36:23 user nova-compute[74934]: No targets found.
Nov 19 15:36:23 user nova-compute[74934]: iSNS:
Nov 19 15:36:23 user nova-compute[74934]: No targets found.
Nov 19 15:36:23 user nova-compute[74934]: STATIC:
Nov 19 15:36:23 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4
Nov 19 15:36:23 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:36:23 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:36:23 user nova-compute[74934]: FIRMWARE:
Nov 19 15:36:23 user nova-compute[74934]: No targets found.
Nov 19 15:36:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:36:23 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:36:23 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61c71a-a768-49a4-9612-82d07f4ee173]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[14afdd08-88d7-4713-a73c-2773d354b7fc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 (non-flash)
Nov 19 15:36:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 (non-flash)
Nov 19 15:36:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c4447ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d138fc4-e002-48f4-9914-ef0bf8dc7f9a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[44537458-f220-4227-a7af-ecf0393ff484]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e2c3af-3910-47bc-bda6-563b4455a8e0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1ac31d-43d2-4c99-a5c7-27485030b270]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[981949f1-e688-404c-98bc-f39b9c8ac7f7]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc7554-be4f-4499-9ce4-b5c790a85742]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260]
Nov 19 15:36:23 user nova-compute[74934]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4, portal: 172.16.0.220,3260] successful.
Nov 19 15:36:23 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:36:23 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3742c256-aaee-48d1-88a8-a7a5a0bc25f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[27857c71-6e6f-4503-bd57-e4337c1363cd]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== disconnect_volume: return (275ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG nova.objects.instance [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:36:24 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-6086abd0-d7df-4104-9ccf-38bdee6b00bf tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.565s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:36:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:28 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:36:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:36:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=25.03752899169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 80076a8f-e917-4738-af07-63381e0601da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:36:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:36:33 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:36:34 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:36:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:36:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:36:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:37 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:42 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:36:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:36:55 user nova-compute[74934]: INFO nova.compute.manager [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attaching volume 5cf83d45-d363-4946-9acc-c5a45b5c14b1 to /dev/vdb
Nov 19 15:36:55 user nova-compute[74934]: DEBUG os_brick.utils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[179754ee-6a7b-4b25-a871-8dd686e99258]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae69bca8-2503-4487-a4ef-2b055805ce13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[85df755f-e7ac-416e-aad3-7d4f4c3cc7f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[29366d48-8dfa-46dc-b583-583d1f414ab2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:36:55 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:36:55 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04de9bf-894d-493a-916f-2f7433e0578d]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG os_brick.utils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:36:55 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating existing volume attachment record: 1fca685b-959c-4c4a-a3b1-13e1ce34fabd {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:36:56 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWKLVnUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:37:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:37:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:37:00 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0fd3c2-5e58-4973-8ea9-09b4a621393e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:37:00 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1a8e90-4272-4258-bdd6-3e8bae65568a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1] added
Nov 19 15:37:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[22955a59-506c-44da-8457-f6e7866a4ca0]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b59371-f5a6-4364-9a0e-b15a79e2d86f]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWKLVnUs {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XWKLVnUs" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0072fe-113c-46e1-aa80-e22a2de94a88]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XWKLVnUs'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a24a502-dcb8-465c-a6c5-82555ff0e8b1]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b174197-aab7-41e1-8c64-c45c5d53c909]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:37:00 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:37:00 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:37:00 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:37:00 user nova-compute[74934]: 
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3211f4a2-65ff-42b2-afc9-6cb1b7c56d42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260]
Nov 19 15:37:00 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260] successful.
Nov 19 15:37:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87812bb-9dce-4f9d-a064-9b74ca9ccecf]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff52a08-8e69-4c01-a059-2e4e38c1844a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 (non-flash)
Nov 19 15:37:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 (non-flash)
Nov 19 15:37:00 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:37:00 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:37:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:37:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:01 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:01 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8ea3ec-426f-4d0f-af75-bef905f9df79]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:01 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWKLVnUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23836303530643338', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836303530643338', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG nova.objects.instance [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:37:02 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:37:02 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:37:02 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:37:02 user nova-compute[74934]:   <serial>5cf83d45-d363-4946-9acc-c5a45b5c14b1</serial>
Nov 19 15:37:02 user nova-compute[74934]: </disk>
Nov 19 15:37:02 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No VIF found with MAC fa:16:3e:9d:a4:26, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:37:02 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-8fe949c0-c73d-4290-aff4-b4674745c9ed tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.110s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:37:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:37:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:37:04 user nova-compute[74934]: INFO nova.compute.manager [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Detaching volume 5cf83d45-d363-4946-9acc-c5a45b5c14b1
Nov 19 15:37:04 user nova-compute[74934]: INFO nova.virt.block_device [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attempting to driver detach volume 5cf83d45-d363-4946-9acc-c5a45b5c14b1 from mountpoint /dev/vdb
Nov 19 15:37:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Attempting to detach device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:37:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:37:04 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:37:04 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:37:04 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:37:04 user nova-compute[74934]:   <serial>5cf83d45-d363-4946-9acc-c5a45b5c14b1</serial>
Nov 19 15:37:04 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:37:04 user nova-compute[74934]: </disk>
Nov 19 15:37:04 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:37:04 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config.
Nov 19 15:37:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:37:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:37:04 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:37:04 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:37:04 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:37:04 user nova-compute[74934]:   <serial>5cf83d45-d363-4946-9acc-c5a45b5c14b1</serial>
Nov 19 15:37:04 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:37:04 user nova-compute[74934]: </disk>
Nov 19 15:37:04 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:37:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:25 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da is timed out.
Nov 19 15:37:25 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config.
Nov 19 15:37:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XWKLVnUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:37:25 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76e8d09-b49b-4b8a-8d59-6a15344a2b1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:37:25 user nova-compute[74934]: No targets found.
Nov 19 15:37:25 user nova-compute[74934]: iSNS:
Nov 19 15:37:25 user nova-compute[74934]: No targets found.
Nov 19 15:37:25 user nova-compute[74934]: STATIC:
Nov 19 15:37:25 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1
Nov 19 15:37:25 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:37:25 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:37:25 user nova-compute[74934]: FIRMWARE:
Nov 19 15:37:25 user nova-compute[74934]: No targets found.
Nov 19 15:37:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:37:25 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:37:25 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2add1521-b093-42ea-b330-8ffdb5adbfa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b18bf5c-d79f-4d9a-b819-70a1ed557dec]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 (non-flash)
Nov 19 15:37:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 (non-flash)
Nov 19 15:37:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13c44060e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2b578-611f-458c-a051-c8350f36d632]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cbbddd-2a0e-4bb9-9b29-bff68d698a75]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc76903f-d3e0-4b92-9049-56466aaf48ee]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1f5f6a-213f-4f77-8e0f-56448547ada8]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12b54a6-78b1-41bb-9d1e-b144edb36a1e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[655db55f-7ae7-4b51-a8ac-5cea2b66d926]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260]
Nov 19 15:37:25 user nova-compute[74934]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1, portal: 172.16.0.220,3260] successful.
Nov 19 15:37:25 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cf83d45-d363-4946-9acc-c5a45b5c14b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[348120c4-6d36-43d0-bd30-c61032ef179c]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== disconnect_volume: return (276ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:37:25 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:37:26 user nova-compute[74934]: DEBUG nova.objects.instance [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:37:26 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-502aa89a-7349-42c3-95ef-9eb777a26931 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.690s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:37:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:30 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:37:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:31 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:37:32 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.036529541015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 80076a8f-e917-4738-af07-63381e0601da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:37:32 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:37:34 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:37:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:38 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:44 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:37:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:37:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:37:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:37:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:37:56 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:37:56 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:37:57 user nova-compute[74934]: INFO nova.compute.manager [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attaching volume 985811c9-c1ca-4f35-b50a-35b5f2e1aeed to /dev/vdb
Nov 19 15:37:57 user nova-compute[74934]: DEBUG os_brick.utils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b9a3e1-6f32-4eb9-bcb9-4ac234be0846]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f38b6121bd2e\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2082f63c-ff2d-4d32-a084-b7ed05808c13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3eb533-8861-4567-88b5-3776edc257e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6be83-c6fe-404d-a2d5-762c3547f1c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Running cmd (subprocess): nvme version {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] 'nvme version' failed. Not Retrying. {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] nvme not present on system {{(pid=74934) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 19 15:37:57 user nova-compute[74934]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 19 15:37:57 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794ceac-26fb-4d31-8864-278a52213939]: (4, '') {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74934) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.lightos [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] LIGHTOS: no hostnqn found. {{(pid=74934) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG os_brick.utils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f38b6121bd2e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:37:57 user nova-compute[74934]: DEBUG nova.virt.block_device [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating existing volume attachment record: 75a03acd-bc5c-4a17-a667-6df692e3701b {{(pid=74934) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 19 15:38:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:01 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Calling os-brick to attach iSCSI Volume {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfVOcgSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:38:02 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:38:02 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:38:02 user nova-compute[74934]: INFO os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3765826-d5ca-4edf-a7aa-dacf4dc205c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 19 15:38:02 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --interface default --op new {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f05b1d-5f41-432a-bc99-bcaf21663345]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed] added\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed] added
Nov 19 15:38:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c2257-aded-41d9-bafd-f279edad3667]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d189757-fd3c-4025-8a62-2c1d6faeb28b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfVOcgSd {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rfVOcgSd" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893c9e4-eccd-42bc-b893-c4dcb9151a90]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rfVOcgSd'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df37c3-22dd-4b97-94ec-2e4bac54ab33]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ffc4d-e667-45f9-8953-be781818139f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:38:02 user nova-compute[74934]:  {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 19 15:38:02 user nova-compute[74934]:  {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:38:02 user nova-compute[74934]: WARNING os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 19 15:38:02 user nova-compute[74934]: 
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --login {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d1d72-a4fd-4558-94a6-7eb1c6fc2500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260]
Nov 19 15:38:02 user nova-compute[74934]: Login to [iface: default, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260] successful.
Nov 19 15:38:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cfe805-3b3d-469f-a044-7f2ac577ecde]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c79c7b-69a0-4bdd-b5db-2f29ca2f9c5b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed (non-flash)
Nov 19 15:38:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed (non-flash)
Nov 19 15:38:02 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to 172.16.0.220:3260 {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74934) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74934) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7721fb6-7eb9-4406-9d93-0234ad2a3bfa]: (4, ('- - 0', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74934) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 19 15:38:02 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfVOcgSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74934) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 19 15:38:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:38:03 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23130623338323136', 'path': '/dev/sdb'} {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:38:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130623338323136', 'path': '/dev/sdb'} {{(pid=74934) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 19 15:38:03 user nova-compute[74934]: DEBUG nova.objects.instance [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:38:03 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] attach device xml: <disk type="block" device="disk">
Nov 19 15:38:03 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:38:03 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:38:03 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:38:03 user nova-compute[74934]:   <serial>985811c9-c1ca-4f35-b50a-35b5f2e1aeed</serial>
Nov 19 15:38:03 user nova-compute[74934]: </disk>
Nov 19 15:38:03 user nova-compute[74934]:  {{(pid=74934) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 19 15:38:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vda, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:38:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74934) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 19 15:38:04 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] No VIF found with MAC fa:16:3e:9d:a4:26, not building metadata {{(pid=74934) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 19 15:38:04 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-c699f2ec-c08b-4b48-89f9-5c1c33044457 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.280s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:38:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:38:06 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:38:06 user nova-compute[74934]: INFO nova.compute.manager [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Detaching volume 985811c9-c1ca-4f35-b50a-35b5f2e1aeed
Nov 19 15:38:06 user nova-compute[74934]: INFO nova.virt.block_device [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Attempting to driver detach volume 985811c9-c1ca-4f35-b50a-35b5f2e1aeed from mountpoint /dev/vdb
Nov 19 15:38:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Attempting to detach device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config. {{(pid=74934) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 19 15:38:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:38:06 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:38:06 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:38:06 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:38:06 user nova-compute[74934]:   <serial>985811c9-c1ca-4f35-b50a-35b5f2e1aeed</serial>
Nov 19 15:38:06 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:38:06 user nova-compute[74934]: </disk>
Nov 19 15:38:06 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:38:06 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the persistent domain config.
Nov 19 15:38:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config. {{(pid=74934) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 19 15:38:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.guest [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] detach device xml: <disk type="block" device="disk">
Nov 19 15:38:06 user nova-compute[74934]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 19 15:38:06 user nova-compute[74934]:   <source dev="/dev/sdb"/>
Nov 19 15:38:06 user nova-compute[74934]:   <target dev="vdb" bus="virtio"/>
Nov 19 15:38:06 user nova-compute[74934]:   <serial>985811c9-c1ca-4f35-b50a-35b5f2e1aeed</serial>
Nov 19 15:38:06 user nova-compute[74934]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 19 15:38:06 user nova-compute[74934]: </disk>
Nov 19 15:38:06 user nova-compute[74934]:  {{(pid=74934) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 19 15:38:06 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:06 user nova-compute[74934]: DEBUG nova.virt.libvirt.driver [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 19 15:38:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:38:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:38:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:38:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:26 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80076a8f-e917-4738-af07-63381e0601da is timed out.
Nov 19 15:38:26 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully detached device vdb from instance 80076a8f-e917-4738-af07-63381e0601da from the live domain config.
Nov 19 15:38:26 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] calling os-brick to detach iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f13dc204d30>, {'target_iqn': 'iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rfVOcgSd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 19 15:38:26 user nova-compute[74934]: WARNING os_brick.initiator.connectors.base [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[31642320-0555-4d53-aa1c-0aff69142370]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 19 15:38:26 user nova-compute[74934]: No targets found.
Nov 19 15:38:26 user nova-compute[74934]: iSNS:
Nov 19 15:38:26 user nova-compute[74934]: No targets found.
Nov 19 15:38:26 user nova-compute[74934]: STATIC:
Nov 19 15:38:26 user nova-compute[74934]: Target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed
Nov 19 15:38:26 user nova-compute[74934]:         Portal: 172.16.0.220:3260,-1
Nov 19 15:38:26 user nova-compute[74934]:                 Iface Name: default
Nov 19 15:38:26 user nova-compute[74934]: FIRMWARE:
Nov 19 15:38:26 user nova-compute[74934]: No targets found.
Nov 19 15:38:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 19 15:38:26 user nova-compute[74934]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 19 15:38:26 user nova-compute[74934]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74934) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed', 0)] {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f267648-a5cd-4114-8f7c-b48b7fc57fcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fea835-0e49-4378-aa3b-cb6c10f5f9fc]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed (non-flash)\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed (non-flash)
Nov 19 15:38:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed (non-flash)
Nov 19 15:38:26 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13e45252d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed'): ({'sdb'}, set())}) {{(pid=74934) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Removing single pathed devices sdb {{(pid=74934) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[61306886-0f00-44a9-81b9-8699fadbf0fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafca28b-3667-44db-b6f5-f6dc2392e742]: (4, ('ok\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Flushing IO for device /dev/sdb {{(pid=74934) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb8ec2-f2ec-4833-8d46-fca93778868e]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74934) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c478d06-64c2-4bfd-803c-130e5d5422b1]: (4, ('1', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.linuxscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] SCSI volumes sdb have been removed. {{(pid=74934) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed')] {{(pid=74934) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d033d-b5e3-43ea-9749-2f7592818c4b]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:26 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --logout {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[2656fbbb-6a0d-4fb1-b20c-6a3aeef62118]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260]
Nov 19 15:38:27 user nova-compute[74934]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed, portal: 172.16.0.220,3260] successful.
Nov 19 15:38:27 user nova-compute[74934]:  stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op delete {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985811c9-c1ca-4f35-b50a-35b5f2e1aeed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd08eb8-24b6-4086-8b0c-986a7361ade2]: (4, ('', '')) {{(pid=86319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74934) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.base [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] <== disconnect_volume: return (294ms) None {{(pid=74934) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Disconnected iSCSI Volume {{(pid=74934) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG nova.objects.instance [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'flavor' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:38:27 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-0ce786cf-b42c-4365-b57d-c223ace19444 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:38:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:32 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 19 15:38:33 user nova-compute[74934]: DEBUG oslo_concurrency.processutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74934) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 19 15:38:34 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:38:34 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9016MB free_disk=25.03557586669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Instance 80076a8f-e917-4738-af07-63381e0601da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74934) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:38:34 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquired lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Forcefully refreshing network info cache for instance {{(pid=74934) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 19 15:38:35 user nova-compute[74934]: DEBUG nova.objects.instance [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lazy-loading 'info_cache' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:38:36 user nova-compute[74934]: DEBUG nova.network.neutron [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [{"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:38:36 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Releasing lock "refresh_cache-80076a8f-e917-4738-af07-63381e0601da" {{(pid=74934) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 19 15:38:36 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updated the network info_cache for instance {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 19 15:38:36 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:38 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:38:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:38:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:38:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:38:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:46 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:38:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:38:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:39:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:39:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:39:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:14 user nova-compute[74934]: INFO nova.compute.manager [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Terminating instance
Nov 19 15:39:14 user nova-compute[74934]: DEBUG nova.compute.manager [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Start destroying the instance on the hypervisor. {{(pid=74934) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-3fe009a1-d022-4d1f-acd0-b4df009b34ee req-827700be-0ea9-48a1-8c90-a40534ec1fc1 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-vif-unplugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3fe009a1-d022-4d1f-acd0-b4df009b34ee req-827700be-0ea9-48a1-8c90-a40534ec1fc1 service nova] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3fe009a1-d022-4d1f-acd0-b4df009b34ee req-827700be-0ea9-48a1-8c90-a40534ec1fc1 service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-3fe009a1-d022-4d1f-acd0-b4df009b34ee req-827700be-0ea9-48a1-8c90-a40534ec1fc1 service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-3fe009a1-d022-4d1f-acd0-b4df009b34ee req-827700be-0ea9-48a1-8c90-a40534ec1fc1 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] No waiting events found dispatching network-vif-unplugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:39:14 user nova-compute[74934]: DEBUG nova.compute.manager [req-3fe009a1-d022-4d1f-acd0-b4df009b34ee req-827700be-0ea9-48a1-8c90-a40534ec1fc1 service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-vif-unplugged-64de4ca8-de34-47d7-808c-1579508203b4 for instance with task_state deleting. {{(pid=74934) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [-] [instance: 80076a8f-e917-4738-af07-63381e0601da] Instance destroyed successfully.
Nov 19 15:39:15 user nova-compute[74934]: DEBUG nova.objects.instance [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lazy-loading 'resources' on Instance uuid 80076a8f-e917-4738-af07-63381e0601da {{(pid=74934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG nova.virt.libvirt.vif [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-19T15:32:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1212808635',display_name='tempest-SnapshotDataIntegrityTests-server-1212808635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1212808635',id=53,image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMlbSCTEBelDkDy2EpjwdbScnrlqWGsMrt1f8rhNin1zODuz1F06vLn84W/QuX39mMZd+1Lr93FOH7ywv1kbmrUzuKyVSYxJgwUTIWnZ6AWMZc1BIS8OEi+sEWneMpIOA==',key_name='tempest-keypair-122573664',keypairs=<?>,launch_index=0,launched_at=2023-11-19T15:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8072f2b042e34ad39991a920301b017b',ramdisk_id='',reservation_id='r-nklu38gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='010d533e-05ed-478e-9adb-00e830e2c77e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-378454966',owner_user_name='tempest-SnapshotDataIntegrityTests-378454966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-19T15:32:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0f5e22095db40369b70a37bbb1e4953',uuid=80076a8f-e917-4738-af07-63381e0601da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Converting VIF {"id": "64de4ca8-de34-47d7-808c-1579508203b4", "address": "fa:16:3e:9d:a4:26", "network": {"id": "33280db8-3253-4065-b2a8-bb424ce37496", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1659131629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8072f2b042e34ad39991a920301b017b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64de4ca8-de", "ovs_interfaceid": "64de4ca8-de34-47d7-808c-1579508203b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG nova.network.os_vif_util [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de') {{(pid=74934) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG os_vif [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de') {{(pid=74934) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64de4ca8-de, bridge=br-int, if_exists=True) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5362f7bd-5b39-45cb-ab76-5f56df8ad281) {{(pid=74934) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:15 user nova-compute[74934]: INFO os_vif [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:a4:26,bridge_name='br-int',has_traffic_filtering=True,id=64de4ca8-de34-47d7-808c-1579508203b4,network=Network(33280db8-3253-4065-b2a8-bb424ce37496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64de4ca8-de')
Nov 19 15:39:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Deleting instance files /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da_del
Nov 19 15:39:15 user nova-compute[74934]: INFO nova.virt.libvirt.driver [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Deletion of /opt/stack/data/nova/instances/80076a8f-e917-4738-af07-63381e0601da_del complete
Nov 19 15:39:15 user nova-compute[74934]: INFO nova.compute.manager [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] [instance: 80076a8f-e917-4738-af07-63381e0601da] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 19 15:39:15 user nova-compute[74934]: DEBUG oslo.service.loopingcall [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74934) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG nova.compute.manager [-] [instance: 80076a8f-e917-4738-af07-63381e0601da] Deallocating network for instance {{(pid=74934) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 19 15:39:15 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 80076a8f-e917-4738-af07-63381e0601da] deallocate_for_instance() {{(pid=74934) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG nova.network.neutron [-] [instance: 80076a8f-e917-4738-af07-63381e0601da] Updating instance_info_cache with network_info: [] {{(pid=74934) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 19 15:39:16 user nova-compute[74934]: INFO nova.compute.manager [-] [instance: 80076a8f-e917-4738-af07-63381e0601da] Took 0.80 seconds to deallocate network for instance.
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:16 user nova-compute[74934]: INFO nova.scheduler.client.report [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Deleted allocations for instance 80076a8f-e917-4738-af07-63381e0601da
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-853e5089-e177-4d97-9976-cfc1cd1b1506 tempest-SnapshotDataIntegrityTests-378454966 tempest-SnapshotDataIntegrityTests-378454966-project-member] Lock "80076a8f-e917-4738-af07-63381e0601da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.003s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] Acquiring lock "80076a8f-e917-4738-af07-63381e0601da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] Lock "80076a8f-e917-4738-af07-63381e0601da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] No waiting events found dispatching network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 19 15:39:16 user nova-compute[74934]: WARNING nova.compute.manager [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received unexpected event network-vif-plugged-64de4ca8-de34-47d7-808c-1579508203b4 for instance with vm_state deleted and task_state None.
Nov 19 15:39:16 user nova-compute[74934]: DEBUG nova.compute.manager [req-11d556c7-6478-4576-b21a-e400c7e9b3e3 req-50817ef9-01e4-4eea-8d03-2931d66138ae service nova] [instance: 80076a8f-e917-4738-af07-63381e0601da] Received event network-vif-deleted-64de4ca8-de34-47d7-808c-1579508203b4 {{(pid=74934) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 19 15:39:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:39:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:39:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:39:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:28 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:32 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:32 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74934) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager.update_available_resource {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Auditing locally available compute resources for user (node: user) {{(pid=74934) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 19 15:39:33 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:39:33 user nova-compute[74934]: WARNING nova.virt.libvirt.driver [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Hypervisor/Node resource view: name=user free_ram=9176MB free_disk=25.06271743774414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74934) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74934) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.compute.provider_tree [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed in ProviderTree for provider: a6d80b64-40fb-4268-950b-1de97ecbab67 {{(pid=74934) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.scheduler.client.report [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Inventory has not changed for provider a6d80b64-40fb-4268-950b-1de97ecbab67 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74934) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG nova.compute.resource_tracker [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Compute_service record updated for user:user {{(pid=74934) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 19 15:39:33 user nova-compute[74934]: DEBUG oslo_concurrency.lockutils [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74934) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 19 15:39:35 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:35 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Starting heal instance info cache {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 19 15:39:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Rebuilding the list of instances to heal {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 19 15:39:35 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Didn't find any instances for network info cache update. {{(pid=74934) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 19 15:39:36 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:39 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:40 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74934) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 19 15:39:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:39:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74934) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 19 15:39:45 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:47 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:50 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:39:50 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 19 15:39:50 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] There are 0 instances to clean {{(pid=74934) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 19 15:39:55 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:39:55 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:58 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:39:58 user nova-compute[74934]: DEBUG nova.compute.manager [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Cleaning up deleted instances with incomplete migration  {{(pid=74934) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 19 15:40:00 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:40:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:05 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:07 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:10 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:15 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:20 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 19 15:40:25 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:30 user nova-compute[74934]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74934) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 19 15:40:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:40:30 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 19 15:40:31 user nova-compute[74934]: DEBUG oslo_service.periodic_task [None req-5af7e2b9-cb2f-4009-84de-9ee7998f343c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74934) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}